-- Logs begin at Wed 2022-08-24 02:43:17 UTC, end at Wed 2022-08-24 04:10:00 UTC. -- Aug 24 03:39:07.217698 dv-cinder-854259-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:39:07.227221 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:39:07 2022] *** Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: nodename: dv-cinder-854259-1-iscsi Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: machine: x86_64 Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: clock source: unix Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: pcre jit disabled Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: detected number of CPU cores: 4 Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: current working directory: / Aug 24 03:39:07.229297 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: your processes number limit is 47680 Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: your memory page size is 4096 bytes Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: detected max file descriptor number: 2048 Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: lock engine: pthread robust mutexes Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: thunder lock: enabled Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:39:07.229977 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:39:07.269778 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: Python main interpreter initialized at 0x5612f55c49c0 Aug 24 03:39:07.269778 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: python threads support enabled Aug 24 03:39:07.269778 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: your server socket listen backlog is limited to 100 connections Aug 24 03:39:07.269778 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:39:07.270233 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:39:07.270233 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: *** Operational MODE: preforking *** Aug 24 03:39:07.270497 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:39:07.270497 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: spawned uWSGI master process (pid: 112620) Aug 24 03:39:07.270711 dv-cinder-854259-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:39:07.273018 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: spawned uWSGI worker 1 (pid: 112621, cores: 1) Aug 24 03:39:07.273018 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: spawned uWSGI worker 2 (pid: 112622, cores: 1) Aug 24 03:39:07.273018 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:39:07.950723 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:39:07.967025 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:39:09.043998 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:39:09.043998 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: from cryptography.utils import int_from_bytes Aug 24 03:39:09.044699 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:39:09.044699 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: from cryptography.utils import int_from_bytes Aug 24 03:39:09.057911 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:39:09.057911 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: from cryptography.utils import int_from_bytes Aug 24 03:39:09.058512 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:39:09.058512 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: from cryptography.utils import int_from_bytes Aug 24 03:39:11.571406 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:39:11.572483 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:39:11.572483 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:39:11.572666 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:39:11.572777 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:39:11.573167 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.573491 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.573810 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.574125 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.581441 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.581441 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.581441 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.581441 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.581778 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:39:11.581778 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:39:11.582260 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.582260 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.582417 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:39:11.582495 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.582495 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854259-1-iscsi {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.582639 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:39:11.582639 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:39:11.582783 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.582783 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.582933 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583008 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583092 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583232 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583324 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583401 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583476 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583563 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583646 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583731 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583808 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583808 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.583923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584001 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584081 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584169 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584252 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584327 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584407 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584489 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584565 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584648 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854259-1-iscsi {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584730 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584805 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584879 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.584953 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585111 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585189 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585264 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585339 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585413 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585525 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585629 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585715 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585791 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854259-1-iscsi {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585874 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.585964 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586043 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586168 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586319 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586404 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586494 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586571 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586647 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586727 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586810 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586887 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.586974 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587051 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587127 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587207 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587290 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587366 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587366 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587513 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587606 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587690 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587781 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587858 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.587936 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588012 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854259-1-iscsi {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588095 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588174 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588238 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588312 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588376 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588468 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588553 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588553 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588688 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588775 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588852 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.588944 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.589120 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.589310 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.589460 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.589606 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.589786 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.589958 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.590107 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.590295 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.590470 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.590605 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.590749 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.590899 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591042 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591186 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591289 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591370 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591523 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591716 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.591913 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.592120 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.592314 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.592515 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.592713 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.592897 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.593080 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.593273 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.593463 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.593652 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.593832 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.594000 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.594195 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.594359 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.594547 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.594728 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.594890 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.595061 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.595220 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.595390 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.595581 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.595756 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.595921 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.596082 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.596246 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.596413 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.596613 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.596799 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.596971 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.597143 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.597303 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.597479 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.597656 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.597821 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.597995 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.598199 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.598392 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.598582 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.598759 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.598942 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.599121 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.599406 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.599589 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.599783 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.600098 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.600286 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.600494 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.600688 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.600875 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.601583 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.601759 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.601931 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.602104 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.602419 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.602605 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.602805 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.603003 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.603203 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.603390 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.603569 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.603754 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.603952 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.604130 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.604130 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.604475 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.604619 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.604759 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.604893 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605017 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605137 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605258 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605378 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605507 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605629 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605749 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605869 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.605991 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606110 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606307 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606432 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606542 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606670 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606791 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.606911 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607042 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607164 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607293 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607422 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607551 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607681 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607810 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.607932 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608059 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608181 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608317 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608643 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608768 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.608889 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609009 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609130 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609260 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609397 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609606 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609732 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609853 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.609972 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610206 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610335 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610457 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610578 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610698 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610820 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.610949 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611071 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611190 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611311 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611432 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611560 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611695 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611823 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.611945 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612066 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612185 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612316 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612438 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612559 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612680 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612811 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.612811 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613057 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613188 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613309 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613443 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613443 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613671 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613805 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.613928 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614049 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614049 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614294 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614420 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614555 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614678 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614799 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.614929 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615051 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615171 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615171 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615408 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615530 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615530 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615764 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.615886 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.616015 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.616136 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.616324 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.616629 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.616763 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.617576 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.617791 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.617927 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.618230 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.618359 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.618537 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.618674 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.619121 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.619250 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.619444 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.619585 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.619786 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.619925 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.620054 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.620261 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.620394 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.620547 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.620675 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:39:11.620866 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.620993 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.621196 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.621340 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.621513 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.621654 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.621827 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.621954 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.622171 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.622301 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.622493 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.622639 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.622814 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.622951 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.623144 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.623277 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.623464 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.623602 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.623785 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.623912 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.624097 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.624245 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.624408 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.624542 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.624717 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.624841 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625037 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625163 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625357 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625491 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625668 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625798 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.625987 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.626112 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.626332 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.626470 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.626654 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.626773 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.626969 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.627103 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.627289 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.627423 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.627619 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.627745 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.627930 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.628064 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.628239 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.628365 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.628562 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.628701 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.628896 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629028 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629209 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629334 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629523 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629654 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629864 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.629998 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.630246 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.630453 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.630590 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.630713 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.630834 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.630964 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.631086 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.631214 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.631384 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.631503 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.631698 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.631831 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.632015 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.632147 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.632352 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.632626 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.632760 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.632966 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.633100 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.633334 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.633459 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.633643 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.633769 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.636116 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.636281 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.636437 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.636686 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.636839 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.636979 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637113 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637237 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637366 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637491 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637611 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637864 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.637985 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638106 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638259 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638383 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638525 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638648 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638770 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.638899 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639025 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639147 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639284 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639414 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639545 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639667 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639796 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.639934 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.640152 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.640280 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.640402 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.640616 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.640745 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.640877 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641130 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641251 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641372 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641494 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641636 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.641847 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.642050 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.642272 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.642677 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.642884 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.643098 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.643305 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.643497 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.643690 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.643886 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.644089 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.644310 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.644510 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.644696 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.644902 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645045 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645182 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645306 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645430 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645563 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645694 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.645960 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646083 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646220 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646344 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646480 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646603 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646736 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646859 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.646982 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647104 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647226 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647348 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647479 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647602 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647723 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.647851 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648015 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648170 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648319 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648453 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648577 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648698 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648828 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.648964 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649095 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649217 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649339 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649460 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649582 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649734 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.649734 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650030 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650202 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650372 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650496 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650496 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650842 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.650961 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651084 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651205 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651335 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651456 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651578 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651708 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651814 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.651935 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652065 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652190 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652310 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652431 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652561 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652770 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.652906 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653030 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653158 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653281 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653415 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653545 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653676 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653796 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.653901 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654028 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654170 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654309 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654440 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654570 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654704 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654826 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.654947 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655081 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655209 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655332 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655461 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655589 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655711 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655840 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.655962 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656090 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656219 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656339 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656455 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656590 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656713 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656833 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.656962 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657083 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657201 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657322 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657445 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657565 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657687 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657807 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.657936 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658065 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658210 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658345 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658477 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658599 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658800 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.658925 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659051 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659171 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659300 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659423 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659554 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659676 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659804 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.659933 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.660116 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.660243 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.660437 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.660565 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.660760 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.660971 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661090 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661220 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661377 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661502 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661687 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661812 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.661999 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.662133 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.662343 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.662479 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.662656 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.662841 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.663045 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.663181 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.663305 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.663433 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.664096 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.664237 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.664553 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.664689 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.664877 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665035 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665183 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665310 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665489 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665617 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665797 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.665922 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.666106 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.666326 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.666463 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.666594 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.666740 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.666868 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667044 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667179 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667357 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667484 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667664 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667790 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.667974 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.668082 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.668268 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.668395 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.668575 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.668699 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.668878 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669013 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669185 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669319 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669495 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669621 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669809 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.669944 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.670109 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.670322 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.670445 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.670567 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.670736 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.670874 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671095 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671227 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671349 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671470 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671631 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671767 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.671956 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672093 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672258 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672379 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672564 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672690 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672865 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.672998 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.673214 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.673347 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.673479 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.673602 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.673780 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.673907 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.674082 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.674241 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.674418 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.674545 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.674726 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.674853 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675031 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675155 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675338 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675465 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675642 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675767 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.675951 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.676077 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.676259 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.676387 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.676565 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.676690 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.676869 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677002 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677187 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677316 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677495 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677619 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677799 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.677932 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.678105 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.678303 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.678430 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.678551 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.678725 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.678866 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.679041 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.679168 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.679978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.680171 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.680335 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.680595 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.680727 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.680850 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.680979 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.681109 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.681338 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.681466 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.681589 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.681713 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.681835 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.682045 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.682212 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.682398 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.682527 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.682738 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.682876 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.683043 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.683198 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.683406 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.683533 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.683656 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.683931 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684065 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684241 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684376 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684547 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684675 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684851 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.684978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.685153 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.685294 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.685462 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.685590 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.685762 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.685888 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686087 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686253 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686389 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686514 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686650 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686784 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.686965 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.687092 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.687268 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.687396 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.687576 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.687702 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.687878 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688023 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688227 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688357 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688545 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688673 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688848 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.688985 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.689151 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.689278 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.689453 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.689580 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.689787 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.689922 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.690089 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.690236 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.690423 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.690548 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.690740 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.690868 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.691048 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.691174 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.691371 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.691546 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.691714 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.691866 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692018 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692166 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692341 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692488 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692645 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692805 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.692954 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.693100 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.693267 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.693402 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.693538 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.693792 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.693946 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694040 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694120 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694319 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694406 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694493 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694628 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694756 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.694961 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.695218 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.695351 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.695514 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.695679 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.695804 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.695934 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696065 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696190 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696312 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696434 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696642 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696776 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.696959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.697086 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.697271 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.697399 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.697576 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.697710 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.697872 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698006 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698201 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698335 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698506 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698646 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698815 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.698940 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.699112 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.699238 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.699413 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.699553 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.699714 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.699841 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700024 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700151 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700331 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700468 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700633 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700759 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.700932 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701056 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701244 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701379 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701596 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701721 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701844 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.701965 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.702132 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.702313 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.702450 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.702657 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.702784 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.702907 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703039 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703342 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703470 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703680 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703804 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.703937 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704060 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704230 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704357 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704529 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704663 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704831 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.704966 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.705133 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.705260 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.705527 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.705671 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.705796 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.705917 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706047 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706187 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706313 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706449 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706611 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706740 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.706910 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707046 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707231 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707367 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707537 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707663 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707838 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.707965 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.708140 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.708269 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.708441 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.708567 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.708767 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.708892 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709068 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709193 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709373 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709506 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709675 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709801 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.709979 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.710107 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.710306 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.710959 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.711188 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.711375 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.711535 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.711806 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.711951 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712075 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712197 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712401 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712526 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712677 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712802 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.712931 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713083 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713221 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713359 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713482 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713612 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713831 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.713958 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.714092 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.714242 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.714472 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.714615 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.714792 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.714919 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.715115 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.715244 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.715438 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.715564 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.715739 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.715865 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716050 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716177 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716359 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716484 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716665 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716800 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.716969 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.717106 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.717275 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.717403 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.717582 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.717721 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.717891 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718019 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718218 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718350 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718528 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718667 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.718966 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.719138 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.719265 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.719447 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.719581 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.719815 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.719940 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.720122 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.720255 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.720444 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.720570 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.720752 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.720879 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.721051 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.721178 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.721355 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.721483 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.721656 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.721874 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722000 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722122 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722277 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722404 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722601 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722727 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.722915 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723052 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723227 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723354 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723541 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723668 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723857 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.723993 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.724159 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.724261 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.724464 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.724573 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.724770 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.724878 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.725071 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.725288 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.725527 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.725625 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.725834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.725945 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.726750 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.727071 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.727211 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.727417 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.727565 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.727798 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.728000 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.728188 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.728363 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.728541 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.728717 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.728912 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.729122 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.729332 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.729528 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.729727 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.729727 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.730713 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.730891 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.731093 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.731312 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.731513 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.731725 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.731939 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732217 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732366 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732494 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732616 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732748 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732872 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732984 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.732984 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.733233 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.733382 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.733507 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.733636 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.733766 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.733896 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734113 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734309 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734448 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734572 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734701 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734824 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.734944 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735077 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735217 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735341 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735461 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735590 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735712 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735712 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.735967 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736091 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736212 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736333 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736468 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736617 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736751 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.736893 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737018 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737140 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737261 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737381 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737511 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737633 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737755 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.737883 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738006 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738119 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738261 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738414 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738542 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738739 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.738873 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739064 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739201 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739370 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739497 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739676 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739802 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.739987 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.740123 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.740290 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.740417 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.740593 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.740721 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.740916 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.741045 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.741218 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.741345 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.741526 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.741652 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.741990 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.742122 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.742354 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.742619 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.742750 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.742873 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.743006 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.743119 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.743291 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.743420 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.743596 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.743729 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.744164 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.744299 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.744479 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.744583 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.744786 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.744894 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.745093 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.745190 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.745406 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.745502 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.745709 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.745814 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746021 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746124 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746350 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746447 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746662 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746825 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.746974 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.747117 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.747269 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.747412 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.747585 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.747740 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.747882 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.748019 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.748196 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.748346 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.748493 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.748615 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.748865 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749015 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749149 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749280 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749423 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749556 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749715 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.749860 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750024 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750186 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750356 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750445 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750662 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750757 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.750965 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751052 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751273 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751359 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751582 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751680 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751883 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.751980 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.752186 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.752315 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.752499 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.752627 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.752800 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.752978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.753111 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.753233 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.753386 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.753514 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.753708 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.753849 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754011 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754138 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754389 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754525 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754648 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754780 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.754953 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.755089 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.755259 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.755388 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.755561 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.755688 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.755915 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756055 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756186 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756297 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756496 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756625 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756798 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.756924 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.757101 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.757226 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.757446 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.757616 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.757862 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.757987 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.758111 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.758313 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.758446 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.758570 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.758737 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.758871 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759044 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759184 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759350 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759484 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759655 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759782 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.759990 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.760193 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.760321 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.760442 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.760606 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.760740 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.760915 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.761172 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.761301 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.761498 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.761625 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.761814 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.761940 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.762126 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.762287 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.762465 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.762592 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.762778 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.762914 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.763090 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.763217 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.763400 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.763527 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.763707 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.763841 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764014 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764140 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764324 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764473 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764674 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764812 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.764945 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.765181 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.765309 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.765511 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.765647 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.765826 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.765953 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.766140 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.766293 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.766479 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.766619 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.766794 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.766920 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.767108 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.767242 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.767443 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.767576 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.767720 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.767847 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768029 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768153 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768338 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768467 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768646 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768772 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.768956 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.769083 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.769267 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.769402 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.769577 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.769713 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.769886 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770026 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770216 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770359 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770528 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770657 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770839 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.770986 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.771150 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.771278 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.771469 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.771604 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.771801 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.771943 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.772114 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.772248 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.772430 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.772558 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.772741 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.772868 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.773643 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.774341 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.774611 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.774829 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.774971 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.775095 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.775265 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.775390 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.775597 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.775729 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.775912 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776036 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776230 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776354 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776553 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776685 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776854 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.776986 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.777157 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.777282 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.777465 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.777600 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.777772 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.777898 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.778071 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.778216 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.778418 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.778559 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.778729 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.778854 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.779031 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.779333 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.779459 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.779642 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.779775 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780012 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780173 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780341 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780521 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780651 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780837 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.780963 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.781163 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.781288 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.781486 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.781613 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.781804 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.781929 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.782111 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.782311 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.782447 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.782572 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.782818 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.782944 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.783160 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.783296 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.783486 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.783652 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.783801 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.784105 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.784232 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.784427 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.784554 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.784740 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.785016 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.785287 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.785402 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.785641 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.785755 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.785948 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.786061 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.786289 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.786428 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.786599 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.786714 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.786923 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787035 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787221 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787345 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787531 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787658 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787836 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.787964 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.788150 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.788286 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.788456 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.788606 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.789376 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.789600 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.789727 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.789938 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.790084 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.790314 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.790440 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.790586 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.790711 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.790895 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791021 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791200 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791325 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791511 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791647 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791814 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.791948 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.792124 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.792250 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.792432 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.792569 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.792740 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.792864 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793047 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793172 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793360 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793500 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793669 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793797 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.793977 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.794104 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.794314 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.794454 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.794621 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.794742 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795014 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795151 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795275 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795410 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795572 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795700 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.795879 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.796127 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.796263 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.796461 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.796587 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.796781 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.796908 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.797086 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.797221 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.797412 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.797538 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.797718 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.797845 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.798022 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.798214 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.798341 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.798447 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.798666 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.798793 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799000 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799128 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799273 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799395 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799584 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799711 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.799895 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.800025 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.800204 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.800331 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.800512 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.800821 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.800955 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.801130 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.801257 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.801440 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.801567 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.801748 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.801885 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.802055 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.802214 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.802393 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.802528 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.802701 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.802829 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803007 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803142 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803316 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803444 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803658 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803786 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.803978 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.804109 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.804385 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.804526 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.804660 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.804784 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.804946 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805087 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805300 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805433 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805564 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805694 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805840 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.805974 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.806176 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.806326 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.806483 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.806618 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.806792 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.806925 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.807103 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.807243 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.807403 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.807528 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.807712 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.807844 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.808027 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.808161 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.808368 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.808496 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.808740 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.808865 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809050 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809177 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809367 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809492 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809684 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809810 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.809993 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.810129 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.810332 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.810458 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.810640 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.810780 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.810951 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.811077 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.811268 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.811395 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.811602 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.811740 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.811919 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.812045 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.812224 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.812351 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.812531 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.812724 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.812851 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.813042 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.813161 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.813365 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.813491 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.813750 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.814067 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.814409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.814543 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.814543 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.814866 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.814991 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.815175 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.815321 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.815581 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.815711 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.815994 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.816181 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.816306 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.816428 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.816628 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.816770 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.816914 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817038 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817161 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817282 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817405 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817536 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817659 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817790 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.817915 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818036 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818174 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818313 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818447 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818584 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818584 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.818941 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819072 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819203 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819333 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819456 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819578 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819690 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.819863 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820039 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820165 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820297 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820429 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820561 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820741 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.820869 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821047 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821174 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821359 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821495 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821663 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821791 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.821968 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.822096 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.822300 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.822442 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.822605 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.822732 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.822909 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823037 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823214 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823350 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823524 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823650 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823828 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.823954 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.824134 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.824270 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.824436 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.824563 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.824740 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.824866 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.825042 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.825170 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.825378 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.825506 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.825742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.825872 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.826046 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.826234 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.826397 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.826542 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.826715 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.826852 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827036 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827345 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827470 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827653 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827855 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.827981 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.828109 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.828278 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.828405 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.828588 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.828722 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.828896 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829021 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829205 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829333 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829514 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829655 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829827 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.829960 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.830136 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.830338 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.830499 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.830631 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.830755 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.831063 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.831191 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.831432 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.831632 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.831759 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.832083 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.832208 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.832404 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.832539 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.832729 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.832857 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.833048 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.833174 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.833361 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.833496 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.833692 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.833818 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834008 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834146 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834344 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834491 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834659 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834814 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.834977 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.835132 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.835290 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.835430 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.836253 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.836385 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.836570 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.836699 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112621) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:39:11.836885 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.837233 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.837552 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.837880 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.838231 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.838546 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.838873 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.839199 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.839547 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.839862 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.840210 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.840539 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.840854 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.841169 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.841476 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:39:11.841722 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112622) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:39:11.992788 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO dbcounter [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Registered counter for database nova_api Aug 24 03:39:12.000855 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO dbcounter [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Registered counter for database nova_api Aug 24 03:39:12.014096 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.020864 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writer thread running {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.023547 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_db.sqlalchemy.engines [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.030333 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writer thread running {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.077984 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.context [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20ac877f-df8d-47d5-b692-2747fb47c4f6(cell1) {{(pid=112621) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:39:12.082005 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.082504 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.084099 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.084856 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.085304 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.088285 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.089185 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.context [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20ac877f-df8d-47d5-b692-2747fb47c4f6(cell1) {{(pid=112622) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:39:12.090338 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO dbcounter [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Registered counter for database nova_cell0 Aug 24 03:39:12.093301 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_concurrency.lockutils [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.093789 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_concurrency.lockutils [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.095532 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_concurrency.lockutils [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.095994 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO dbcounter [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Registered counter for database nova_cell1 Aug 24 03:39:12.096282 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_concurrency.lockutils [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:12.096768 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_concurrency.lockutils [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:12.098923 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_concurrency.lockutils [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112622) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:12.100981 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO dbcounter [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Registered counter for database nova_cell0 Aug 24 03:39:12.104018 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.105731 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.107173 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO dbcounter [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Registered counter for database nova_cell1 Aug 24 03:39:12.114426 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_db.sqlalchemy.engines [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.114985 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writer thread running {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.116561 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_db.sqlalchemy.engines [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.117318 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writer thread running {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.124209 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writer thread running {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.125747 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writer thread running {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.264320 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO dbcounter [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Registered counter for database nova_cell0 Aug 24 03:39:12.271823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_db.sqlalchemy.engines [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112621) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.276165 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO dbcounter [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Registered counter for database nova_cell0 Aug 24 03:39:12.276960 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writer thread running {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.282854 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG oslo_db.sqlalchemy.engines [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112622) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:39:12.287376 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writer thread running {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:39:12.708505 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: WARNING keystonemiddleware.auth_token [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:39:12.716055 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: WARNING keystonemiddleware.auth_token [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:39:12.742924 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: WARNING keystonemiddleware.auth_token [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:39:12.750694 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: WARNING keystonemiddleware.auth_token [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:39:13.064938 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: WARNING keystonemiddleware.auth_token [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:39:13.070987 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: WARNING keystonemiddleware.auth_token [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:39:13.076265 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612f55c49c0 pid: 112621 (default app) Aug 24 03:39:13.078403 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:13.079593 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001801 Aug 24 03:39:13.080008 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Wed Aug 24 03:39:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:13.100095 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: WARNING keystonemiddleware.auth_token [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:39:13.107872 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: WARNING keystonemiddleware.auth_token [None req-1477ed2e-b866-40d4-a34a-b2f2a42791d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:39:13.113281 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612f55c49c0 pid: 112622 (default app) Aug 24 03:40:36.942762 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:36.944546 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002139 Aug 24 03:40:36.944942 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:36.963905 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_api:SELECT=3 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:36.965644 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_cell0:SELECT=3 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:36.966460 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_cell1:SELECT=3 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:36.967941 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:37.840058 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5483af54-a0f6-42b1-91dc-8c9903f67404 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:37.871931 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5483af54-a0f6-42b1-91dc-8c9903f67404 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919890 Aug 24 03:40:37.872981 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 03:40:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:40.276953 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:40.277958 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-5ec19ad5-a1f3-40a6-8733-0afc53661856 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 24 03:40:40.278593 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:40.717533 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-1d6052cd-0b44-40ef-9673-7fd02140f1cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "disk": 1, "id": "c1", "swap": 0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:40.737433 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:40:40.737433 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: warnings.warn(msg) Aug 24 03:40:40.812741 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-1d6052cd-0b44-40ef-9673-7fd02140f1cf admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.527688 Aug 24 03:40:40.818493 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:40:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:40:40.827888 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_api:SELECT=3 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:40.828696 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell0:SELECT=3 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:40.829421 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell1:SELECT=3 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:40.830211 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:41.034865 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-f36451c4-4c86-4a79-a82a-ef64224d6bad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:41.039307 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:40:41.039307 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:40:41.142171 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-f36451c4-4c86-4a79-a82a-ef64224d6bad admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.319765 Aug 24 03:40:41.142955 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 03:40:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:43.578320 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-1d6052cd-0b44-40ef-9673-7fd02140f1cf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:43.579960 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-1d6052cd-0b44-40ef-9673-7fd02140f1cf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Aug 24 03:40:43.580463 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:44.307503 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-ce2a1e7f-5a4a-4157-80d8-be0b86835425 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:44.326623 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:40:44.326623 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:40:44.480121 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-ce2a1e7f-5a4a-4157-80d8-be0b86835425 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.891851 Aug 24 03:40:44.481063 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:40:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:40:44.494433 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-0e77eaa1-3e16-4fbf-92aa-4f1adeaffc02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:44.497469 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:40:44.497469 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: warnings.warn(msg) Aug 24 03:40:44.641595 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-0e77eaa1-3e16-4fbf-92aa-4f1adeaffc02 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.151999 Aug 24 03:40:44.646723 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 03:40:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:47.057557 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-ce2a1e7f-5a4a-4157-80d8-be0b86835425 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:47.058604 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-ce2a1e7f-5a4a-4157-80d8-be0b86835425 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 03:40:47.059013 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:47.478396 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-993ee22a-8559-4a3d-aca1-e9fcc27a1307 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:47.540666 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-993ee22a-8559-4a3d-aca1-e9fcc27a1307 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475470 Aug 24 03:40:47.541217 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:40:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:40:47.553591 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-3b091ea4-6e86-490c-a701-eb3407671201 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:47.623866 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-3b091ea4-6e86-490c-a701-eb3407671201 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073955 Aug 24 03:40:47.624405 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 03:40:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:50.018570 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-993ee22a-8559-4a3d-aca1-e9fcc27a1307 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:50.020264 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-993ee22a-8559-4a3d-aca1-e9fcc27a1307 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 Aug 24 03:40:50.021953 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:50.460042 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-dfa2c8e6-e09f-439d-8fb2-5514ac15caf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:50.563579 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-dfa2c8e6-e09f-439d-8fb2-5514ac15caf7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.534614 Aug 24 03:40:50.564286 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:40:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:40:50.577719 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-032cd4d4-e847-4ebd-b37c-742be9852db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:50.691268 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-032cd4d4-e847-4ebd-b37c-742be9852db5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117793 Aug 24 03:40:50.692025 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 03:40:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:53.096061 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-dfa2c8e6-e09f-439d-8fb2-5514ac15caf7 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:53.097063 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-dfa2c8e6-e09f-439d-8fb2-5514ac15caf7 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 03:40:53.097644 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:53.540160 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-0e90569e-770e-44dc-bd06-7fed3f86d594 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G"}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:53.629408 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-0e90569e-770e-44dc-bd06-7fed3f86d594 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.525012 Aug 24 03:40:53.630750 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:40:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:40:53.642970 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-da8e6e30-76d7-4db7-925f-45a7a8f37f47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:53.720505 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-da8e6e30-76d7-4db7-925f-45a7a8f37f47 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081275 Aug 24 03:40:53.721084 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1336 bytes} [Wed Aug 24 03:40:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:56.354549 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-0e90569e-770e-44dc-bd06-7fed3f86d594 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.355560 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-0e90569e-770e-44dc-bd06-7fed3f86d594 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 24 03:40:56.356538 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:56.808651 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-e5b1bc89-f6c5-45b4-8e35-81050144115c admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:56.832959 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-e5b1bc89-f6c5-45b4-8e35-81050144115c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470382 Aug 24 03:40:56.834309 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 03:40:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:40:59.178266 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-0e90569e-770e-44dc-bd06-7fed3f86d594 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:59.179335 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-0e90569e-770e-44dc-bd06-7fed3f86d594 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002345 Aug 24 03:40:59.179768 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:59.623736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-e061f37c-fa6f-4903-b5a2-0daa5f9e1830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:59.757474 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-e061f37c-fa6f-4903-b5a2-0daa5f9e1830 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.571628 Aug 24 03:40:59.757953 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:40:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:40:59.774118 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-8e9b59a2-054b-43f6-8943-e1485ce7347c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:59.876727 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-8e9b59a2-054b-43f6-8943-e1485ce7347c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108072 Aug 24 03:40:59.877386 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 03:40:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:02.260701 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-e061f37c-fa6f-4903-b5a2-0daa5f9e1830 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:02.261800 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-e061f37c-fa6f-4903-b5a2-0daa5f9e1830 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Aug 24 03:41:02.262240 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:02.688839 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-3013bdb4-107f-4291-8a18-36e0af67376e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:02.764716 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-3013bdb4-107f-4291-8a18-36e0af67376e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.496244 Aug 24 03:41:02.765377 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:41:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:41:02.778609 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-17d1db0d-75db-4e72-9097-f255712e03cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:02.887425 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-17d1db0d-75db-4e72-9097-f255712e03cb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112379 Aug 24 03:41:02.888006 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 03:41:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:41:05.283019 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-3013bdb4-107f-4291-8a18-36e0af67376e admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:05.284941 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-3013bdb4-107f-4291-8a18-36e0af67376e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002517 Aug 24 03:41:05.285580 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:05.807188 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-86cf15dd-1122-40fe-b7ac-9dbb9191eeba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "swap": 0, "id": "3"}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:05.884111 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-86cf15dd-1122-40fe-b7ac-9dbb9191eeba admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.591391 Aug 24 03:41:05.890879 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:41:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:41:05.897330 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-7f79263f-c1eb-45ab-8e8d-ee1f0822370c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:05.996359 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-7f79263f-c1eb-45ab-8e8d-ee1f0822370c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102778 Aug 24 03:41:05.997253 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 03:41:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:08.507212 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-86cf15dd-1122-40fe-b7ac-9dbb9191eeba admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:08.508133 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-86cf15dd-1122-40fe-b7ac-9dbb9191eeba admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 03:41:08.508532 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:41:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:08.976703 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-9683f181-4900-4e0c-8dae-0d9ac90e9e2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "vcpus": 4}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:08.983366 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:09.067108 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-9683f181-4900-4e0c-8dae-0d9ac90e9e2d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.551941 Aug 24 03:41:09.068616 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:41:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:09.080914 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-3ffc3c14-ca95-4df6-8ec1-0ca42b4beb02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:09.167130 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-3ffc3c14-ca95-4df6-8ec1-0ca42b4beb02 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090010 Aug 24 03:41:09.168054 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 03:41:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:11.582437 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-9683f181-4900-4e0c-8dae-0d9ac90e9e2d admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:11.583962 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-9683f181-4900-4e0c-8dae-0d9ac90e9e2d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001789 Aug 24 03:41:11.584647 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:12.093286 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-4df235fc-57e4-4664-b3a1-eac1e048e0d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:12.705980 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-4df235fc-57e4-4664-b3a1-eac1e048e0d1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.115151 Aug 24 03:41:12.706702 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1283 bytes} [Wed Aug 24 03:41:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:12.720255 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-96fa139b-6397-4450-90ed-db8aa328f947 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:12.829884 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-96fa139b-6397-4450-90ed-db8aa328f947 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113999 Aug 24 03:41:12.830818 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1333 bytes} [Wed Aug 24 03:41:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:41:32.831303 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-4df235fc-57e4-4664-b3a1-eac1e048e0d1 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:32.833282 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-4df235fc-57e4-4664-b3a1-eac1e048e0d1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Aug 24 03:41:32.833901 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:32.845732 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:33.236634 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-4b372a75-e546-4542-802b-a9aa9eb3585c admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:33.257001 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-4b372a75-e546-4542-802b-a9aa9eb3585c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415619 Aug 24 03:41:33.257561 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 03:41:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:34.328569 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-4df235fc-57e4-4664-b3a1-eac1e048e0d1 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:34.329583 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-4df235fc-57e4-4664-b3a1-eac1e048e0d1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 24 03:41:34.329982 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:34.869225 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-1ba6dd98-59ad-4755-bf0b-f98b1edf2fcb admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:34.874789 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.wsgi [None req-1ba6dd98-59ad-4755-bf0b-f98b1edf2fcb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-1ba6dd98-59ad-4755-bf0b-f98b1edf2fcb admin admin] Request method failure captured: Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Accept: application/json Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Accept-Encoding: gzip, deflate Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Connection: keep-alive Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Content-Length: 0 Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Host: 10.222.0.65 Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Openstack-Api-Version: compute 2.90 Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Openstack-System-Scope: None Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: User-Agent: python-novaclient Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Auth-Token: gAAAAABjBZ3uOMEtRbJOI2vSaYb88yEFTDsquyu2TSO0yFqRmoY_H8IT1xoZvYxx4spQgQSwvoFbT-NZFi4nVZ0mh9CN3tp86ih2fSqBWYx6tDS-wCs8DIkzwwMXXFHBMSjfY5mwMY2oKvWOuGX0ybO6qWUZLyy2rxXTyWE1ztoDta8bo0eCGhk Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Domain-Id: None Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Domain-Name: None Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Identity-Status: Confirmed Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Is-Admin-Project: True Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Domain-Id: default Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Domain-Name: Default Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Name: admin Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Role: admin,member,reader Aug 24 03:41:34.878007 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Roles: admin,member,reader Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant: admin Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant-Name: admin Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User: admin Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Domain-Id: default Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Domain-Name: Default Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Id: c73de3f5e3b94a3182c45d2476903a00 Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Name: admin Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: method: > Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: exception: Flavor 42 could not be found. Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: action_args: {'id': '42'} Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:34.879742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:34.880836 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.883163 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-1ba6dd98-59ad-4755-bf0b-f98b1edf2fcb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:34.884440 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-1ba6dd98-59ad-4755-bf0b-f98b1edf2fcb admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402872 Aug 24 03:41:34.884440 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 03:41:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:34.889667 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-eadede22-c9ee-4c93-9cf8-b6e65f9f0c8f admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:34.894095 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:34.912619 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-eadede22-c9ee-4c93-9cf8-b6e65f9f0c8f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026530 Aug 24 03:41:34.913197 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 03:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:34.930739 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-4e342a7e-b4b7-44c3-8407-3f8da15a8bb3 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:34.954731 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-4e342a7e-b4b7-44c3-8407-3f8da15a8bb3 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030893 Aug 24 03:41:34.955287 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 03:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:34.965409 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-457bbb9c-326f-43fb-9211-23f43758b5c5 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:34.971276 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.wsgi [None req-457bbb9c-326f-43fb-9211-23f43758b5c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-457bbb9c-326f-43fb-9211-23f43758b5c5 admin admin] Request method failure captured: Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Accept: application/json Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Accept-Encoding: gzip, deflate Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Connection: keep-alive Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Content-Length: 0 Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Host: 10.222.0.65 Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Openstack-Api-Version: compute 2.90 Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Openstack-System-Scope: None Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: User-Agent: python-novaclient Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Auth-Token: gAAAAABjBZ3uOMEtRbJOI2vSaYb88yEFTDsquyu2TSO0yFqRmoY_H8IT1xoZvYxx4spQgQSwvoFbT-NZFi4nVZ0mh9CN3tp86ih2fSqBWYx6tDS-wCs8DIkzwwMXXFHBMSjfY5mwMY2oKvWOuGX0ybO6qWUZLyy2rxXTyWE1ztoDta8bo0eCGhk Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Domain-Id: None Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Domain-Name: None Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Identity-Status: Confirmed Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Is-Admin-Project: True Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Domain-Id: default Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Domain-Name: Default Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Name: admin Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Role: admin,member,reader Aug 24 03:41:34.975160 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Roles: admin,member,reader Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant: admin Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant-Name: admin Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User: admin Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Domain-Id: default Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Domain-Name: Default Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Id: c73de3f5e3b94a3182c45d2476903a00 Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Name: admin Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: method: > Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: exception: Flavor 42 could not be found. Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: action_args: {'id': '42'} Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:34.982828 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:34.984439 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:34.985758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-457bbb9c-326f-43fb-9211-23f43758b5c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:34.987268 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-457bbb9c-326f-43fb-9211-23f43758b5c5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015150 Aug 24 03:41:34.987268 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 03:41:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:35.954169 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-4e342a7e-b4b7-44c3-8407-3f8da15a8bb3 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:35.955199 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-4e342a7e-b4b7-44c3-8407-3f8da15a8bb3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 03:41:35.955600 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:36.484757 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-399f2964-26ea-4da9-b0d9-fa14ecc83fa4 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.491290 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.wsgi [None req-399f2964-26ea-4da9-b0d9-fa14ecc83fa4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-399f2964-26ea-4da9-b0d9-fa14ecc83fa4 admin admin] Request method failure captured: Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Accept: application/json Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Accept-Encoding: gzip, deflate Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Connection: keep-alive Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Content-Length: 0 Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Host: 10.222.0.65 Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Openstack-Api-Version: compute 2.90 Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Openstack-System-Scope: None Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: User-Agent: python-novaclient Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Auth-Token: gAAAAABjBZ3vWjzXGUqln3ATjIkZo1MinM32AQtjLYSMaSYNESbvptrcJ0HRG0kpWelFUzm_G9S5EOnVjQjiI09n9JKlPu9Ke7u1Wwrl-DIORh0W-ANCo-tC8Zu6kTGjwSn4ydrdmLweZZDmNVT9RB4fkIWNG2g2eU5YjpaCzOZOfNW92vxOqtM Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Domain-Id: None Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Domain-Name: None Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Identity-Status: Confirmed Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Is-Admin-Project: True Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Domain-Id: default Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Domain-Name: Default Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Name: admin Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Role: admin,member,reader Aug 24 03:41:36.492834 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Roles: admin,member,reader Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant: admin Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant-Name: admin Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User: admin Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Domain-Id: default Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Domain-Name: Default Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Id: c73de3f5e3b94a3182c45d2476903a00 Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Name: admin Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: method: > Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: exception: Flavor 84 could not be found. Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: action_args: {'id': '84'} Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:36.494686 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:36.495736 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.496823 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-399f2964-26ea-4da9-b0d9-fa14ecc83fa4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:36.497837 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-399f2964-26ea-4da9-b0d9-fa14ecc83fa4 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400805 Aug 24 03:41:36.497837 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:36.504561 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-7323e227-ab66-4586-9568-d894e3bdd043 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.519481 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-7323e227-ab66-4586-9568-d894e3bdd043 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018811 Aug 24 03:41:36.520021 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:36.529675 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-7cd30860-cccf-41ca-9381-39861df043e5 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.545323 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-7cd30860-cccf-41ca-9381-39861df043e5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019154 Aug 24 03:41:36.545858 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:41:36.555872 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-13e775ba-6738-447b-8c26-cfac62d59001 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:36.561227 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.wsgi [None req-13e775ba-6738-447b-8c26-cfac62d59001 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-13e775ba-6738-447b-8c26-cfac62d59001 admin admin] Request method failure captured: Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Accept: application/json Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Accept-Encoding: gzip, deflate Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Connection: keep-alive Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Content-Length: 0 Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Host: 10.222.0.65 Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Openstack-Api-Version: compute 2.90 Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Openstack-System-Scope: None Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: User-Agent: python-novaclient Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Auth-Token: gAAAAABjBZ3vWjzXGUqln3ATjIkZo1MinM32AQtjLYSMaSYNESbvptrcJ0HRG0kpWelFUzm_G9S5EOnVjQjiI09n9JKlPu9Ke7u1Wwrl-DIORh0W-ANCo-tC8Zu6kTGjwSn4ydrdmLweZZDmNVT9RB4fkIWNG2g2eU5YjpaCzOZOfNW92vxOqtM Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Domain-Id: None Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Domain-Name: None Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Identity-Status: Confirmed Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Is-Admin-Project: True Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Domain-Id: default Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Domain-Name: Default Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Name: admin Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Role: admin,member,reader Aug 24 03:41:36.562816 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Roles: admin,member,reader Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant: admin Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant-Name: admin Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User: admin Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Domain-Id: default Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Domain-Name: Default Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Id: c73de3f5e3b94a3182c45d2476903a00 Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Name: admin Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: method: > Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: exception: Flavor 84 could not be found. Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: action_args: {'id': '84'} Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:36.564978 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:36.566409 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:36.567959 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-13e775ba-6738-447b-8c26-cfac62d59001 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:36.569686 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-13e775ba-6738-447b-8c26-cfac62d59001 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011947 Aug 24 03:41:36.569686 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Wed Aug 24 03:41:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:37.541708 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-7cd30860-cccf-41ca-9381-39861df043e5 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:37.542806 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-7cd30860-cccf-41ca-9381-39861df043e5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 24 03:41:37.543206 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:38.069742 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-3343a5f1-2aec-4daf-8c14-1215d6684c97 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.075416 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.wsgi [None req-3343a5f1-2aec-4daf-8c14-1215d6684c97 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-3343a5f1-2aec-4daf-8c14-1215d6684c97 admin admin] Request method failure captured: Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Accept: application/json Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Accept-Encoding: gzip, deflate Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Connection: keep-alive Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Content-Length: 0 Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Host: 10.222.0.65 Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Openstack-Api-Version: compute 2.90 Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Openstack-System-Scope: None Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: User-Agent: python-novaclient Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Auth-Token: gAAAAABjBZ3xv5U8A70NisW0m7Cfhyxe6vDArNNXyfskFsKArP4o6-VseLbr9_s0ybrp4iLlQneojqFs7Xl05akpLEQ9C-QFOhwALvPjZ0bejUV_VPdDBkGqG9P_D7SzoVcQQfvz-vwgWQPOhoNkAwFuIU6a_3lQLNQeG-vQ7PqOPWeUH8zNKbU Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Domain-Id: None Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Domain-Name: None Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Identity-Status: Confirmed Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Is-Admin-Project: True Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Domain-Id: default Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Domain-Name: Default Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Project-Name: admin Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Role: admin,member,reader Aug 24 03:41:38.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Roles: admin,member,reader Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant: admin Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-Tenant-Name: admin Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User: admin Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Domain-Id: default Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Domain-Name: Default Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Id: c73de3f5e3b94a3182c45d2476903a00 Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: X-User-Name: admin Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: method: > Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: exception: Flavor 451 could not be found. Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: action_args: {'id': '451'} Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:38.078566 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:38.079438 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.080501 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-3343a5f1-2aec-4daf-8c14-1215d6684c97 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112622) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:38.081530 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-3343a5f1-2aec-4daf-8c14-1215d6684c97 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394468 Aug 24 03:41:38.081530 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:41:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:38.088172 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-fdfb145a-2ca2-48c8-becf-2edc98357e11 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.103352 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-fdfb145a-2ca2-48c8-becf-2edc98357e11 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018744 Aug 24 03:41:38.103871 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:38.113065 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.128925 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019306 Aug 24 03:41:38.129702 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:41:38.138847 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-49515974-26a8-48bb-9399-2892e023f003 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:38.144048 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.wsgi [None req-49515974-26a8-48bb-9399-2892e023f003 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-49515974-26a8-48bb-9399-2892e023f003 admin admin] Request method failure captured: Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Accept: application/json Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Accept-Encoding: gzip, deflate Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Connection: keep-alive Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Content-Length: 0 Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Host: 10.222.0.65 Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Openstack-Api-Version: compute 2.90 Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Openstack-System-Scope: None Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: User-Agent: python-novaclient Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Auth-Token: gAAAAABjBZ3xv5U8A70NisW0m7Cfhyxe6vDArNNXyfskFsKArP4o6-VseLbr9_s0ybrp4iLlQneojqFs7Xl05akpLEQ9C-QFOhwALvPjZ0bejUV_VPdDBkGqG9P_D7SzoVcQQfvz-vwgWQPOhoNkAwFuIU6a_3lQLNQeG-vQ7PqOPWeUH8zNKbU Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Domain-Id: None Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Domain-Name: None Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Identity-Status: Confirmed Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Is-Admin-Project: True Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Domain-Id: default Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Domain-Name: Default Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Project-Name: admin Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Role: admin,member,reader Aug 24 03:41:38.145716 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Roles: admin,member,reader Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b8d28080f87c4783b9ef971b31a0d51a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant: admin Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant-Id: b8d28080f87c4783b9ef971b31a0d51a Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-Tenant-Name: admin Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User: admin Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Domain-Id: default Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Domain-Name: Default Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Id: c73de3f5e3b94a3182c45d2476903a00 Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: X-User-Name: admin Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: method: > Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: exception: Flavor 451 could not be found. Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: action_args: {'id': '451'} Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:41:38.147330 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:38.148416 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: ERROR nova.api.openstack.wsgi Aug 24 03:41:38.149923 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-49515974-26a8-48bb-9399-2892e023f003 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112621) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:41:38.151190 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-49515974-26a8-48bb-9399-2892e023f003 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011797 Aug 24 03:41:38.151190 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:41:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 03:41:39.132360 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:39.133661 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001761 Aug 24 03:41:39.134135 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:39.665535 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-7ecb2175-f695-4b0b-9010-31288e964214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:39.739498 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-7ecb2175-f695-4b0b-9010-31288e964214 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.466390 Aug 24 03:41:39.740159 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 03:41:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:40.715676 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:40.716690 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 24 03:41:40.717122 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:41.244527 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-f944d2dc-ce31-486f-a308-c56917a460f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:41.340924 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-f944d2dc-ce31-486f-a308-c56917a460f8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.485032 Aug 24 03:41:41.341648 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 03:41:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:42.330073 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:42.331211 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 03:41:42.331641 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:42.867102 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-07ec6813-cf98-43f4-93b1-a2c9bfafd612 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:42.938398 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-07ec6813-cf98-43f4-93b1-a2c9bfafd612 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.463924 Aug 24 03:41:42.938957 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 03:41:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:43.930198 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:43.931210 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 24 03:41:43.931599 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:44.469490 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-f26826b7-7c68-4298-89f4-1cbc59577bec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:41:44.573638 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-f26826b7-7c68-4298-89f4-1cbc59577bec admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.501931 Aug 24 03:41:44.574219 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Wed Aug 24 03:41:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:41:45.567855 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:45.569171 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001750 Aug 24 03:41:45.569669 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:41:46.097594 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-40327eb6-1e4b-47e2-9f05-e5dfabade12a admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:41:46.119020 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-40327eb6-1e4b-47e2-9f05-e5dfabade12a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410765 Aug 24 03:41:46.119575 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Wed Aug 24 03:41:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:42:40.933693 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:40.934766 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-5d121b74-dc97-46db-a6c5-21d798a7d9bf admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 24 03:42:40.935172 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 931 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:42:40.945454 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:41.358895 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-4002c833-58fc-4d30-8344-67ef288c41ae admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.381028 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-4002c833-58fc-4d30-8344-67ef288c41ae admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.439922 Aug 24 03:42:41.381608 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1292 bytes} [Wed Aug 24 03:42:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:42:41.403983 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG dbcounter [-] [112622] Writing DB stats nova_api:SELECT=14 {{(pid=112622) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:41.407706 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-bebd0297-f642-4506-8164-3d9bf9f1469e admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.416128 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-bebd0297-f642-4506-8164-3d9bf9f1469e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013298 Aug 24 03:42:41.416318 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:41.431066 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-8704ad2d-b6ea-4a6a-a08d-195f1756c746 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.439450 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-8704ad2d-b6ea-4a6a-a08d-195f1756c746 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013934 Aug 24 03:42:41.439901 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:42:41.454013 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.463006 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012674 Aug 24 03:42:41.463563 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1286 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:42:41.475796 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-e804dd2a-da74-4baf-96f3-48f78e67e59e admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:42:41.483697 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-e804dd2a-da74-4baf-96f3-48f78e67e59e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011781 Aug 24 03:42:41.484278 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1283 bytes} [Wed Aug 24 03:42:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:45:59.624068 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:59.625093 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 03:45:59.625489 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:45:59.766483 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_api:SELECT=6 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:59.931101 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:45:59.933435 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:45:59.933435 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:45:59.934597 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.935136 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.935588 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.936304 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:59.936752 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:59.937196 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:59.972771 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-b8489e09-daba-425a-b9ca-cbdef5eebb06 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207732 Aug 24 03:45:59.973365 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:45:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:00.828323 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:00.829402 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 24 03:46:00.829808 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:01.029662 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:01.032063 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:01.032063 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:46:01.033168 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.033729 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.034098 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.034835 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:01.035277 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:01.035689 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:01.055125 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-8545137c-a34e-4431-96a0-6e445cc30a89 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079003 Aug 24 03:46:01.055702 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:46:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:12.322225 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:12.323332 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 24 03:46:12.323736 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:12.470504 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell0:SELECT=4 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:12.471249 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell1:SELECT=4 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:12.471877 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_api:SELECT=8 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:12.524322 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:12.526860 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:12.526860 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:46:12.528003 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.528636 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.529562 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.530262 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:12.530262 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:12.530698 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:12.551965 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-9e46a2b6-2cf0-4509-8f76-5b53adfa1677 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085875 Aug 24 03:46:12.552582 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:46:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:13.397737 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.398776 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 03:46:13.399171 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:13.597360 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:13.599980 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:13.599980 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:46:13.601099 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.601580 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.602008 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.602758 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:13.603202 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:13.603617 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:13.624753 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-1ff6e2ca-89a8-4936-897e-fc09cefeee38 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082207 Aug 24 03:46:13.625244 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:46:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:46:24.862441 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:24.863462 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001757 Aug 24 03:46:24.863865 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 38/77] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:25.010767 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell0:SELECT=4 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.011490 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_cell1:SELECT=4 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.012111 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG dbcounter [-] [112621] Writing DB stats nova_api:SELECT=8 {{(pid=112621) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:25.062005 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.064429 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:25.064429 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:46:25.065572 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.066047 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.066555 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.067324 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.068285 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.068743 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.097184 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-c34cd685-3ccf-48a5-9bf7-1d4fadd91ef9 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090875 Aug 24 03:46:25.097761 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 40/78] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:46:25.943417 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: DEBUG nova.api.openstack.wsgi [None req-63268492-301f-43ed-8338-12227c590195 admin admin] Calling method '>' {{(pid=112622) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.944489 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: INFO nova.api.openstack.requestlog [None req-63268492-301f-43ed-8338-12227c590195 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Aug 24 03:46:25.948424 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: [pid: 112622|app: 0|req: 39/79] 10.222.0.65 () {56 vars in 1074 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:26.147733 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG nova.api.openstack.wsgi [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Calling method '>' {{(pid=112621) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:26.150042 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:46:26.150042 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: warnings.warn(msg) Aug 24 03:46:26.151243 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.151637 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.152065 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.152780 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:26.153224 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:26.153639 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: DEBUG oslo_concurrency.lockutils [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112621) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:26.176045 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: INFO nova.api.openstack.requestlog [None req-34d38b31-3820-4173-be7e-270d6e06dccc admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086303 Aug 24 03:46:26.176614 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: [pid: 112621|app: 0|req: 41/80] 10.222.0.65 () {60 vars in 1193 bytes} [Wed Aug 24 03:46:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:47:28.663387 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: Wed Aug 24 03:47:28 2022 - graceful shutdown triggered... Aug 24 03:47:28.663908 dv-cinder-854259-1-iscsi devstack@n-api.service[112622]: Gracefully killing worker 2 (pid: 112622)... Aug 24 03:47:28.664345 dv-cinder-854259-1-iscsi devstack@n-api.service[112621]: Gracefully killing worker 1 (pid: 112621)... Aug 24 03:47:28.667020 dv-cinder-854259-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 03:47:29.664549 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: worker 1 buried after 1 seconds Aug 24 03:47:29.664549 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: worker 2 buried after 1 seconds Aug 24 03:47:29.664549 dv-cinder-854259-1-iscsi devstack@n-api.service[112620]: goodbye to uWSGI. Aug 24 03:47:29.666806 dv-cinder-854259-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 03:47:29.667356 dv-cinder-854259-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 03:47:29.670120 dv-cinder-854259-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 03:47:29.680346 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 03:47:29.683459 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:47:29 2022] *** Aug 24 03:47:29.683625 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:47:29.683757 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:47:29.683876 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: nodename: dv-cinder-854259-1-iscsi Aug 24 03:47:29.683985 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: machine: x86_64 Aug 24 03:47:29.684093 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: clock source: unix Aug 24 03:47:29.684208 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: pcre jit disabled Aug 24 03:47:29.684337 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: detected number of CPU cores: 4 Aug 24 03:47:29.684448 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: current working directory: / Aug 24 03:47:29.684566 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:47:29.684680 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: your processes number limit is 47680 Aug 24 03:47:29.684790 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: your memory page size is 4096 bytes Aug 24 03:47:29.684899 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: detected max file descriptor number: 2048 Aug 24 03:47:29.685013 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: lock engine: pthread robust mutexes Aug 24 03:47:29.685292 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: thunder lock: enabled Aug 24 03:47:29.685593 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 03:47:29.685866 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:47:29.726316 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: Python main interpreter initialized at 0x55ac2c9e29c0 Aug 24 03:47:29.726316 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: python threads support enabled Aug 24 03:47:29.726316 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: your server socket listen backlog is limited to 100 connections Aug 24 03:47:29.726316 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:47:29.726778 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:47:29.726778 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: *** Operational MODE: preforking *** Aug 24 03:47:29.727039 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:47:29.727039 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: spawned uWSGI master process (pid: 127723) Aug 24 03:47:29.727269 dv-cinder-854259-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 03:47:29.729821 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: spawned uWSGI worker 1 (pid: 127736, cores: 1) Aug 24 03:47:29.729821 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: spawned uWSGI worker 2 (pid: 127737, cores: 1) Aug 24 03:47:29.729821 dv-cinder-854259-1-iscsi devstack@n-api.service[127723]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:47:30.401958 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:47:30.409299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 03:47:31.574674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:47:31.574674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: from cryptography.utils import int_from_bytes Aug 24 03:47:31.575333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:47:31.575333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: from cryptography.utils import int_from_bytes Aug 24 03:47:31.580201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:47:31.580201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: from cryptography.utils import int_from_bytes Aug 24 03:47:31.580646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:47:31.580646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: from cryptography.utils import int_from_bytes Aug 24 03:47:34.042504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:47:34.043091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:47:34.043313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:47:34.043691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:47:34.043950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:47:34.044340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.044670 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.044993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.045315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.045799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.046117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.046480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.046805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.047140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.047404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.047723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.048051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854259-1-iscsi {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.048377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.052980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.053313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.053624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.053940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.054368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854259-1-iscsi {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.054686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.055003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.055319 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.055847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.056300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.056552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.056846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.057176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.057488 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.057834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.058142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.058494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.058821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.059125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.059439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.059747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.060072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.060382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.060688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.060942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.061255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.061577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.061897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.062242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.062497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.062748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.063066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.063387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.063706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.064014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.064323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.064628 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.064934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.065239 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.065547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.065855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.066204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.066511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.066835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.067144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.067465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.067868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.068154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.068496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.068845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.069164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.069736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.070070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.070423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.070738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.071053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.071530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.071968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.072495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.072812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.073073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.073385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.073705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.074030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.074370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.074684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.074998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.075304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.075672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.075972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.076296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.076638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.076950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.077294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.077610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.077921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.078265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.078611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.078938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.079249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.079561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.079913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.080223 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.080552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.080903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.081220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.081548 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.081881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.082214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.082541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.082850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.083160 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.083483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.083794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.084105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.084425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.084734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.085039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.085407 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.085729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.086077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.086381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.086680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.087589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.087899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.088222 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.088547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.088864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.089173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.089481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.089801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.090142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.090498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.090845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.091160 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.091497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.091830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.092151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.092467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.092786 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.093117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.093434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.093754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.094069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.094419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.094741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.095076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.095399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.095721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.096046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.096363 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.096794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.097016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.097343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.097659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.098004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.098376 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.098697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.099023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.099353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.099669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.099984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.100298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.100620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.100960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.101275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.101596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.101911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.102247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.103116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.103507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.103884 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.104820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.104820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.105201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.105201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.105638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.105819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.106132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.106473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.106787 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.107075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.107388 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.107702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.108010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.109517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.109517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.109517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.109517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.110109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.110109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.110439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.110583 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.110930 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.111110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.111466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.111788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.112099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.112412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.112723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.113052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.113362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.113674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.113994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.114335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.114652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.114965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.115282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.115609 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.115926 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.116241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.116581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.116916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.117224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.117551 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.118178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.118500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.118810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.119120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.119426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.119733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.120039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.120351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.120656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.120961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.121264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.121569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.121875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.122229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.122544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.122852 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.123226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.123537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.123894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.124203 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.124549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.124887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.125210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.125537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.125899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.126205 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.126501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.126814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.127127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.127444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.127764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.128079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.128400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.128713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.129038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.129352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.129674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.129982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.130323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.130666 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.131001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.131320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.131645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.131958 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.132276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.132586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.132898 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.133262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.133579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.133932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.134267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.134594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.134903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.135228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.135541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.135862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.136167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.136481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.136808 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.137142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.137545 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.137764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.138087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.138426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.138740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.139051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.139359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.139665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.139976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.140293 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.140714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.140959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.141274 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.142089 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.142089 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.142458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.142603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.142847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.143219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.143487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.143814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.144137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.144446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.144756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.145074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.145387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.145695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.146001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.146315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.146668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.146981 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.147289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.147695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.147950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.148273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.148594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.148928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.149251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.150192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.150523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.150960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.151315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.151636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.151955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.152273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.152602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.152975 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.153297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.153615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.153966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.154347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.154675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.155294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.155631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.155995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.156346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.156677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.157001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.157339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.158044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.158044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.158435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.158765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.159085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.159400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.159738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.160088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.160434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.160783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.161221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.161437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.161908 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.162065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.162406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.162728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.163084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.163422 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.163732 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.164063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.164377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.164686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.165107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.165565 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.165922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.166261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.166615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.166950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.167299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.167616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.167932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.168264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.168576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.168889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.169199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.169513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.169826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.170135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.170473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.170791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.171108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.171422 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.171731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.172045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.172408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.172673 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.173032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.173341 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.173648 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.173961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.174300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.174611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.174926 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.175236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.175552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.175859 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.176165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.176470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.176785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.177093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.177399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.177724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.178036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.178368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.178675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.178991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.179297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.179601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.179911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.180236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.181162 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.181434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.181698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.182006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.182339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.182699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.183038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.183344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.183650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.183955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.184262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.184573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.184903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.185217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.185523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.185887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.186256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.187317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.187317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.187317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.187794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.187963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.188195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.188515 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.188832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.189156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.189466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.189856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.190097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.190443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.190765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.191055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.191385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.191702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.192019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.192342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.192670 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.192999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.193307 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.193620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.193933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.194267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.194587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.194900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.195217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.195654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.195916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.196313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.197125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.197521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.197743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.198056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.198395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.198734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.199050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.199360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.199674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.199986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.200302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.200611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.201061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.201379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.201694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.202004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.202344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.202750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.203092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.203393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.203701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.204144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.204461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.204784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.205104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.205415 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.205723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.206039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.206397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.206709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.207019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.207329 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.207675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.207966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.208292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.208727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.209048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.209395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.209780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.210097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.210449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.210779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.211108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.211437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.211748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.212626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.212626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.212834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.213133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.213453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.213772 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.214084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.214441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.214778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.215100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.215427 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.215884 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.216196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.216509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.216838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.217168 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.217477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.217788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.218105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.218440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.218756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.219143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.219487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.221867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.222199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.222384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.222661 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.222976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.223208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.223536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.223849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.224188 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.224455 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.224904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.225258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.225572 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.225899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.226854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.226854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.227334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.227334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.228370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.228536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.228692 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.229027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.229339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.229846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.230002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.230268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.230581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.230889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.231202 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.231508 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.231815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.232581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.232581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.233181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.233181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.233472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.233733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.234041 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.234384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.234736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.235045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.235382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.235698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.236029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.236351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.236671 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.236989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.237307 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.237682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.237936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.238334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.238590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.238908 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.239226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.239544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.240130 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.240466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.240785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.241096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.241412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.241729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.242043 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.242384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.243004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.243825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.244145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.244575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.244997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.245332 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.245679 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.246006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.246352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.246672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.246989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.247357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.247678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.247983 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.248293 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.248616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.248934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.249251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.249564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.249881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.250589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.250589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.250911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.251141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.251459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.251784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.252127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.252454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.253512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.253512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.253512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.254099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.254345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.254629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.254951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.255278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.255599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.255985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.256379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.256570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.256858 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.257173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.257485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.257791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.258122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.258455 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.258833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.259124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.259632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.260312 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.260913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.261067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.261293 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.261724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.261947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.262278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.262694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.263008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.263321 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.263642 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.263959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.264270 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.264578 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.264900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.265211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.265512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.265824 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.266133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.266489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.266797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.267105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.267412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.267726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.268035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.268367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.268640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.268930 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.269249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.269556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.269870 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.270192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.270512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.271120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.271120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.271432 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.271730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.272039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.272408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.272734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.273047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.273451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.273689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.274006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.274517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.274842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.275739 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.275917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.276152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.276496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.276831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.277145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.277452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.277761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.278090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.278520 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.278738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.279036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.279348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.279663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.279976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.280291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.280605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.281150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.281470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.281636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.281826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.282140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.282477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.282802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.283160 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.283607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.283806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.284126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.284447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.285644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.285644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.285644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.285644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.286519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.286519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.286810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.286954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.287365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.287680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.288001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.294815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.296004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.297113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.298325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.299412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.299412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.299412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.299412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.300275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.300275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.300934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.301100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:47:34.303892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.304067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:47:34.304230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.304230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.304511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:47:34.304667 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.304820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:47:34.304820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:47:34.305167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.305167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.305449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.305670 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.305824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.305979 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.306126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.306348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.306495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.306655 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.306808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.306955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.307119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.307273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.307503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.307651 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.307805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.307950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.308096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.308248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.308408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.308556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.308710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.308855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.309022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854259-1-iscsi {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.309169 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.309327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.309473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.309617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.310193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.310365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.310523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.310671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.310824 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.310977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.314285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.314487 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.314669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.314822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.314971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.314971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.315247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.315424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.315579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.315727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.315871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.316016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.316160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.316331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.316477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.316622 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.316766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.316918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.317072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.317228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.317374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.317519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.317664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.317664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.317938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.318197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.318365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.318365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.318652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854259-1-iscsi {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.318652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.318937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.319104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.319251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.319402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.319557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.319712 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.319879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.320045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.320254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.320413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.320583 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.320749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.320749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.321027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.321728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.321905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.322067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.322447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.322616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.322939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.328725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.329741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.330957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.332467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.333603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.334830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.335930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.337287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.337287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.337287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.337287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.337287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.338139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.338139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.338503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.338646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.340371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.340371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.340371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.340371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.340371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.340371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.341332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.341332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.341332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.341759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.341925 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.342074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.343307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.343307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.343307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.343307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.343930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.343930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.344223 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.344482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.344790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.345092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.345409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:47:34.345749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.346079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.346449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.346762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.347096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.347424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.347741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.348052 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.348365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.348689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.349567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.349567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.349881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.350044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.350254 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.350588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.350904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.351221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.351543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.351855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.352173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.353088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.353609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.353976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.354370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.354718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.355039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.355362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.355690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.356003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.356368 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.356670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.356943 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.357274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.357587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.357904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.358240 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.358557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.358870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.359265 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.359814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.359814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.360133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.360426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.360739 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.361055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.361366 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.361678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.361987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.362328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.362636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.363036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.363354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.363664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.363989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.364319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.364628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.364965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.365275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.365588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.365898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.366233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.366541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.366854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.367165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.367472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.369131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.370013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.370013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.370385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.370685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.370997 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.371319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.371635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.371951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.372279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.372580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.372956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.373222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.373534 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.373869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.374212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.374519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.374844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.375169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.375485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.375789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.376096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.376400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.376703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.377006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.377314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.377616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.377918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.378271 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.378579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.378883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.379207 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.379552 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.379822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.380283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.380447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.380741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.381045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.381254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO dbcounter [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Registered counter for database nova_api Aug 24 03:47:34.381457 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.381745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.382017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.382438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.382753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.383068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.383377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.383718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.384626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.385161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.386083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.386083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.386083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.386623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.386786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.387064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.387388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.387695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.388010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.388352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.388688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.389007 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.389331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.389702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.389983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.390480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.390655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.391409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.391409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.391731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.391884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.392181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.392410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.392735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.393046 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.393364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.393666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.393980 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.394334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.394694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.395002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.395314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.395635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.395944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.396255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.396563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.396867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.398058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.398058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.398058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.398576 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.398576 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.398873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.399106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.400784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.400784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.402235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.402235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.402235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.402235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.402823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.402823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.403059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.403229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.404780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_db.sqlalchemy.engines [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.405174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.405515 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.405842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.406181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.406504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.406859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.407180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.407492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.407816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.408142 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.408457 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.408779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.409093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.409406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.412184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.413828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.413828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.413828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.413828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.413828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.413828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.417095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.417640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.417832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.418387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.418566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.418936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.419294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.419589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.419950 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.420267 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.420711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.420899 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.421494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.421649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.422392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.422392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.422648 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.422778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writer thread running {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.423077 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.423077 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.423351 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.423656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.424187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.424555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.424872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.425194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.425509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.425838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.426195 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.426489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.426976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.427212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.427442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.427750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.428095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.428430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.428774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.429086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.429396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.429726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.430041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.430375 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.430873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.431307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.431857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.432171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.432490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.432807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.433122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.433436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.433744 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.434055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.434389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.434711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.435022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.435330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.435760 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.435942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.436253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.436558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.436940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.437217 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.437562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.438625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.438625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.438625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.439044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.439185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.439456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.439784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.440104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.440410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.440728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.441143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.441356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.441626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.442095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.442358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.442570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.442874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.443185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.443492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.443798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.444103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.444413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.444714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.445016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.445318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.445623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.445925 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.446863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.447424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.447823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.448136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.448444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.448798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.449108 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.449472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.449783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.450101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.450458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.450773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.451120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.451441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.451693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.452201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.452360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.452622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.453096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.453241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.453542 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.453858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.454221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.454512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.454837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.455163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.455468 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.455776 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.456089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.456408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.456704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.457016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.457326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.457641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.458136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.458307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.458587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.458892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.459202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.459514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.459819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.460147 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.460464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.460767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.461079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.461493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.461743 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.462996 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.463449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.463771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.464089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.464399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.464714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.465029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.465349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.465668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.465973 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.466487 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.473919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.475453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.476470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.477623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.478803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.478803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.478803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.478803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.478803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.479452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.479452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.480237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.480237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.480505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.480636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.480886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.481217 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.482052 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.482052 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.482379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.482513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.483131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.483131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.483420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.483665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.483840 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.context [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20ac877f-df8d-47d5-b692-2747fb47c4f6(cell1) {{(pid=127737) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:47:34.483990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.484296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.484622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.484947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.485255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.485581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.485894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.486239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.486548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.486857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.487209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.487519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.487851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.488185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.488338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:34.488515 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.488688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:34.488837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.489149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.489485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.489807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.490126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.490345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.490492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.490794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.491099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.491242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:34.491411 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.491604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:34.491829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.492325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.492325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.492603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.493457 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.493763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.493987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.494361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.494703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.495014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.495417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.495657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.495970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.496170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO dbcounter [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Registered counter for database nova_cell0 Aug 24 03:47:34.496308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.496572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.496930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.497238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.497574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.497891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.498247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.498673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.503656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.503656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.503656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.503656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.503656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.503656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO dbcounter [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Registered counter for database nova_cell1 Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.504976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.505307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.505442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.505789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.506111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.506470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.506814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.507143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.507462 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.507782 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.508283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.508490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.509836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_db.sqlalchemy.engines [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.510019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.510019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.510365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.510530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_db.sqlalchemy.engines [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.510682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.511086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.511273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.511576 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.511891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.512213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.512530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.512843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.513156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.513533 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.513794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.514134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.514479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.514794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.515109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.515425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.515985 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.516305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.516642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.516972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.517071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writer thread running {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.517298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.517617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.517938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.518330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.518441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writer thread running {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.518641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.518954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.519261 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.519570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.519876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.520196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.520515 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.520822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.521142 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.521452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.522069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.522441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.522762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.523089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.523414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.523732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.524039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.524965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.525512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.526027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.526322 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.526642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.526952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.527263 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.527581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.527894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.528202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.528512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.528819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.529149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.529456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.529765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.530071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.530415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.530729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.531035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.531341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.531644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.531958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.532265 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.532576 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.532881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.533194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.533499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.533807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.534112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.534462 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.534768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.535119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.535439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.535750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.536076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.536392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.536710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.537058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.537376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.537931 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.538291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.538610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.538949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.539276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.539581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.539918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.540421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.540978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.541303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.541621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.541935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.542278 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.542591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.542908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.543224 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.543537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.543847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.544157 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.544469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.544777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.545087 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.545397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.545715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.546058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.546405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.546725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.547043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.547362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.547673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.547982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.548293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.548603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.548922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.549251 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.549564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.549871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.550323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.550642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.550960 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.551282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.551591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.551910 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.552232 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.552543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.552863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.553173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.553502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.553843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.554184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.554513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.554819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.555124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.555428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.555802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.556379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.556746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.557056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.557364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.557678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.557986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.558326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.558632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.558938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.559247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.559549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.559852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.560154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.560456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.560762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.561064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.561371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.561673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.561976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.562303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.562607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.562909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.563241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.563574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.563890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.564212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.564525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.564847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.565156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.565480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.565804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.566122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.566458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.566793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.567104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.567415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.567729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.568039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.568349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.568659 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.568986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.569314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.569620 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.569945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.570287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.570613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.570929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.571827 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.572378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.572802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.573123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.573440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.573756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.574069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.574427 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.574742 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.575054 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.575373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.575691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.576018 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.576345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.576655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.576983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.577308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.577657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.577971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.578340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.578667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.578982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.579297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.579602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:47:34.579844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:47:34.644221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO dbcounter [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Registered counter for database nova_api Aug 24 03:47:34.664715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_db.sqlalchemy.engines [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.667191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO dbcounter [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Registered counter for database nova_cell0 Aug 24 03:47:34.671812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writer thread running {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.673965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_db.sqlalchemy.engines [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.678487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writer thread running {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.729418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.context [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),20ac877f-df8d-47d5-b692-2747fb47c4f6(cell1) {{(pid=127736) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 03:47:34.733598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:34.734088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:34.735685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.736434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:47:34.736887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:47:34.738930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:47:34.740937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO dbcounter [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Registered counter for database nova_cell0 Aug 24 03:47:34.745794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO dbcounter [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Registered counter for database nova_cell1 Aug 24 03:47:34.753051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_db.sqlalchemy.engines [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.754404 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_db.sqlalchemy.engines [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.762428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writer thread running {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.762774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writer thread running {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:34.911286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO dbcounter [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Registered counter for database nova_cell0 Aug 24 03:47:34.918866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_db.sqlalchemy.engines [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:47:34.923976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writer thread running {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:47:35.007069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: WARNING keystonemiddleware.auth_token [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:47:35.014819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: WARNING keystonemiddleware.auth_token [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:47:35.253608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: WARNING keystonemiddleware.auth_token [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:47:35.261937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: WARNING keystonemiddleware.auth_token [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:47:35.360940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: WARNING keystonemiddleware.auth_token [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:47:35.367046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: WARNING keystonemiddleware.auth_token [None req-b2df8e3e-e4f9-4462-8f26-bf58920b4624 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:47:35.373298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac2c9e29c0 pid: 127737 (default app) Aug 24 03:47:35.612098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: WARNING keystonemiddleware.auth_token [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 03:47:35.619309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: WARNING keystonemiddleware.auth_token [None req-53f2564c-f5c9-447d-adb8-97c847c7fbf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 03:47:35.624759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ac2c9e29c0 pid: 127736 (default app) Aug 24 03:48:14.317799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=3 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.321315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=3 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.325796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=3 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.326080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=3 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:15.026951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-db0821ac-5d23-43d9-a5e3-334e19279bd0 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Action: 'create', calling method: .version_select at 0x7f6c196ec700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1324881107"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:16.636523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-db0821ac-5d23-43d9-a5e3-334e19279bd0 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.337999 Aug 24 03:48:16.637813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Wed Aug 24 03:48:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2341 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 03:48:16.664016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:16.667333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:16.687949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:16.693939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:17.186698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-948756a0-93d3-4602-b67d-001d8486a943 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c1973a0d0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:17.790822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-948756a0-93d3-4602-b67d-001d8486a943 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776" status: 200 len: 345 microversion: 2.1 time: 1.138534 Aug 24 03:48:17.798604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 1/2] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:16 2022] GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 => generated 345 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:18.814222 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e7b17679-7e80-4bb1-825c-505359c70a60 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195be550>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:18.893602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e7b17679-7e80-4bb1-825c-505359c70a60 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776" status: 200 len: 346 microversion: 2.1 time: 0.089828 Aug 24 03:48:18.894622 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:18 2022] GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:18.910403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-eea1f92f-5226-4d3b-a486-91439aecac03 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Action: 'create', calling method: .version_select at 0x7f6c195ff5e0>, body: {"snapshot": {"volume_id": "84cd5bfc-05c9-4ad1-8f5c-61413f8f3776", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1691312381"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:20.177266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-eea1f92f-5226-4d3b-a486-91439aecac03 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.272643 Aug 24 03:48:20.185526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 2/4] 10.222.0.65 () {60 vars in 1162 bytes} [Wed Aug 24 03:48:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:20.192006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-aaa99e1c-3cbe-4f65-ad96-818ad2af096e tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195bec10>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:20.279775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-aaa99e1c-3cbe-4f65-ad96-818ad2af096e tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.093906 Aug 24 03:48:20.280644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:20 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:20.292613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-43beb716-d0b2-48bf-9bbc-a5d924cc7c32 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195ff1f0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:20.391730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-43beb716-d0b2-48bf-9bbc-a5d924cc7c32 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.103254 Aug 24 03:48:20.404597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-661cf55d-da3f-403e-a7ea-104a39475a63 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195d73a0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:20.407746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 24 03:48:20 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:20.454504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-661cf55d-da3f-403e-a7ea-104a39475a63 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.053488 Aug 24 03:48:20.455255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:20 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:21.485809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7c16ef91-30a5-4406-af78-a4f14c3c0285 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195d64c0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:21.544142 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7c16ef91-30a5-4406-af78-a4f14c3c0285 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.070186 Aug 24 03:48:21.544690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:21 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:22.557498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f6cc5a1e-6d6d-408a-ab22-df001456a554 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195bec10>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:22.664273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f6cc5a1e-6d6d-408a-ab22-df001456a554 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.109647 Aug 24 03:48:22.669460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 5/9] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:22 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:23.677522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0ec25c36-5fbc-45d9-af83-ab29500a1e05 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195bb820>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:23.725260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0ec25c36-5fbc-45d9-af83-ab29500a1e05 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.053035 Aug 24 03:48:23.725813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 5/10] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:23 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:24.746282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-eb119dea-db1d-46d8-9714-08a702584a49 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195be550>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:24.818590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-eb119dea-db1d-46d8-9714-08a702584a49 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.084015 Aug 24 03:48:24.819676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 6/11] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:24 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:25.833380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d901cbe6-4563-4def-a471-e417bbbb2852 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195ff3a0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:25.893568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d901cbe6-4563-4def-a471-e417bbbb2852 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 288 microversion: 2.1 time: 0.065133 Aug 24 03:48:25.902492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:25 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 288 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:25.907622 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d5c1ff4c-fb91-483f-a4b0-a8152090a6ee tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195d75e0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.223230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d5c1ff4c-fb91-483f-a4b0-a8152090a6ee tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 202 len: 0 microversion: 2.1 time: 0.318852 Aug 24 03:48:26.225190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 24 03:48:25 2022] DELETE /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:26.234628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c26bdb09-2cf4-4493-8a5e-a636a869a177 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c19f96b80>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:26.286977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c26bdb09-2cf4-4493-8a5e-a636a869a177 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.057574 Aug 24 03:48:26.288796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 7/14] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:26 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:27.300856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a491e654-a2ef-4ad5-ab08-2074dc0ca554 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195d79d0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:27.519078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a491e654-a2ef-4ad5-ab08-2074dc0ca554 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.221970 Aug 24 03:48:27.519841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 8/15] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:27 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:28.532206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-41f1c7bb-fb1b-4739-ae52-39cecd4b3c13 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195d6280>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:28.751968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-41f1c7bb-fb1b-4739-ae52-39cecd4b3c13 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 200 len: 287 microversion: 2.1 time: 0.223451 Aug 24 03:48:28.753216 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:28 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 287 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:29.773453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9273f2c-9b55-45b5-9670-15e742e6ebfd tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195be310>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:29.843790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-c9273f2c-9b55-45b5-9670-15e742e6ebfd tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] HTTP exception thrown: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9273f2c-9b55-45b5-9670-15e742e6ebfd tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Request method failure captured: Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 HTTP/1.1 Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ9-taMTg4fSDFBM3N_nsC8-B0ag7nQzG3Kyg1dNem8UZ3Y6rCXspM6WvMq4-4k1wRLUDFKEi2ABiXHosCsAauesNiOH8F9as9iqGVSeakwcTqk4kOBi0kmeFFol_XDS2nElYe6OPitSZKM2thO0VB0aOfp_V501S9ZGhwtOpQDZbrU Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:48:29.848399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 28150f2ee18e47c783f906a162e568bb Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'f632d1c4-9310-47bb-9aab-c96cdae5f995'} Aug 24 03:48:29.849638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. (HTTP 404) (Request-ID: req-c7ff2e48-6d1c-4b98-bed2-75e7de89512f) Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.850477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:29.852140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 03:48:29.853864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. Aug 24 03:48:29.855414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:29.858240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9273f2c-9b55-45b5-9670-15e742e6ebfd tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Returning 404 to user: Snapshot f632d1c4-9310-47bb-9aab-c96cdae5f995 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:29.859260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9273f2c-9b55-45b5-9670-15e742e6ebfd tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995" status: 404 len: 111 microversion: 2.1 time: 0.097440 Aug 24 03:48:29.860181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 9/17] 10.222.0.65 () {58 vars in 1251 bytes} [Wed Aug 24 03:48:29 2022] GET /compute/v2.1/os-snapshots/f632d1c4-9310-47bb-9aab-c96cdae5f995 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:29.873211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-58e9fafe-870e-4ad1-91a0-3e02af57ce80 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c195bbd30>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:30.300250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-58e9fafe-870e-4ad1-91a0-3e02af57ce80 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776" status: 202 len: 0 microversion: 2.1 time: 0.435876 Aug 24 03:48:30.302497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 9/18] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:48:29 2022] DELETE /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:48:30.394560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-49cc9220-1c54-42d0-93be-51e26d8369cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: .version_select at 0x7f6c19f97a60>, body: {"keypair": {"name": "tempest-keypair-569282096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5cu+ZdmY+aaPnQnc/3wj7tzvXm4opRRYvBU5l7JCZ6q3i1jEDfVBT2YaFdk8lzu0s+joLRGJjf7gU7D0kvJfv2o1dWcPAhfScYnKcH3mQT9dVwHOocw0JX/w2R4UmHqQ=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:30.580110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1731146765", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:30.590018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-49cc9220-1c54-42d0-93be-51e26d8369cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:30.610578 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-49cc9220-1c54-42d0-93be-51e26d8369cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:30.748608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] validate_networks() for [('36cb3bc8-9b57-4e0a-ae7e-6971cdae89f2', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:30.816652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-49cc9220-1c54-42d0-93be-51e26d8369cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.762877 Aug 24 03:48:30.824947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 10/19] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:48:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:30.831477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ec20a792-53d5-4c8c-b6a8-386bd5f9e566 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c19509e50>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.150048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-ec20a792-53d5-4c8c-b6a8-386bd5f9e566 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] HTTP exception thrown: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ec20a792-53d5-4c8c-b6a8-386bd5f9e566 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Request method failure captured: Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 HTTP/1.1 Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ9-taMTg4fSDFBM3N_nsC8-B0ag7nQzG3Kyg1dNem8UZ3Y6rCXspM6WvMq4-4k1wRLUDFKEi2ABiXHosCsAauesNiOH8F9as9iqGVSeakwcTqk4kOBi0kmeFFol_XDS2nElYe6OPitSZKM2thO0VB0aOfp_V501S9ZGhwtOpQDZbrU Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:48:31.152582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 28150f2ee18e47c783f906a162e568bb Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '84cd5bfc-05c9-4ad1-8f5c-61413f8f3776'} Aug 24 03:48:31.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. (HTTP 404) (Request-ID: req-c7d06c56-a1b2-4eb5-b256-3fee9c59bf59) Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.154843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:31.156020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:48:31.156985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.158095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.160751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ec20a792-53d5-4c8c-b6a8-386bd5f9e566 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Returning 404 to user: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.161786 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ec20a792-53d5-4c8c-b6a8-386bd5f9e566 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776" status: 404 len: 109 microversion: 2.1 time: 0.342877 Aug 24 03:48:31.162528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 11/20] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:30 2022] GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 => generated 109 bytes in 344 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.300326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ce590fe9-5649-4a7a-9be3-5e02cbc14853 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'create', calling method: .version_select at 0x7f6c1953aaf0>, body: {"keypair": {"name": "tempest-keypair-918565050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNf0WjqYvor0+IrX4quQDkc22rhYPd/pg29j1ftS07DwD6G8CbS54ATFN+RrqueioEG0HLu9QunhrI3opOm00kMVDp2XAm/2Jnp+8LnKIbaZtvS049kveTkAvKrqraqlw=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:31.360927 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-ce590fe9-5649-4a7a-9be3-5e02cbc14853 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:31.379689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-ce590fe9-5649-4a7a-9be3-5e02cbc14853 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for user bd8d967d9ecb410ea47e130ac3c8b4a6 and project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:31.546390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ce590fe9-5649-4a7a-9be3-5e02cbc14853 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.381663 Aug 24 03:48:31.547219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 12/21] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 24 03:48:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 384 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:48:31.555061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-95246793-c328-4af1-b66b-16dc4b514261 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c18cd6940>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.662096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-95246793-c328-4af1-b66b-16dc4b514261 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] HTTP exception thrown: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-95246793-c328-4af1-b66b-16dc4b514261 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Request method failure captured: Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 HTTP/1.1 Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ9-taMTg4fSDFBM3N_nsC8-B0ag7nQzG3Kyg1dNem8UZ3Y6rCXspM6WvMq4-4k1wRLUDFKEi2ABiXHosCsAauesNiOH8F9as9iqGVSeakwcTqk4kOBi0kmeFFol_XDS2nElYe6OPitSZKM2thO0VB0aOfp_V501S9ZGhwtOpQDZbrU Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:48:31.664611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 28150f2ee18e47c783f906a162e568bb Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '84cd5bfc-05c9-4ad1-8f5c-61413f8f3776'} Aug 24 03:48:31.665965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. (HTTP 404) (Request-ID: req-9013b951-168a-4747-9dac-12c19569ba9f) Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.673371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:48:31.674547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:48:31.675690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-95246793-c328-4af1-b66b-16dc4b514261 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Returning 404 to user: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-95246793-c328-4af1-b66b-16dc4b514261 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776" status: 404 len: 109 microversion: 2.1 time: 0.120194 Aug 24 03:48:31.676794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 13/22] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:48:31 2022] DELETE /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:31.683609 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-78d3db3e-43cc-4237-9f6e-9dc62fe2e475 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Calling method '.version_select at 0x7f6c18cd6b80>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:31.755333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-78d3db3e-43cc-4237-9f6e-9dc62fe2e475 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] HTTP exception thrown: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-78d3db3e-43cc-4237-9f6e-9dc62fe2e475 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Request method failure captured: Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 HTTP/1.1 Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ9-taMTg4fSDFBM3N_nsC8-B0ag7nQzG3Kyg1dNem8UZ3Y6rCXspM6WvMq4-4k1wRLUDFKEi2ABiXHosCsAauesNiOH8F9as9iqGVSeakwcTqk4kOBi0kmeFFol_XDS2nElYe6OPitSZKM2thO0VB0aOfp_V501S9ZGhwtOpQDZbrU Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:48:31.758615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6252f05139f14716a83b4ea1cd7048ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 6252f05139f14716a83b4ea1cd7048ad Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1088355955 Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 28150f2ee18e47c783f906a162e568bb Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1088355955-project Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '84cd5bfc-05c9-4ad1-8f5c-61413f8f3776'} Aug 24 03:48:31.759716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. (HTTP 404) (Request-ID: req-bc978647-94ce-49ac-933c-04d7a7452d6c) Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.760361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:48:31.761256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:48:31.762175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-78d3db3e-43cc-4237-9f6e-9dc62fe2e475 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] Returning 404 to user: Volume 84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-78d3db3e-43cc-4237-9f6e-9dc62fe2e475 tempest-VolumesSnapshotsTestJSON-1088355955 tempest-VolumesSnapshotsTestJSON-1088355955-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776" status: 404 len: 109 microversion: 2.1 time: 0.082767 Aug 24 03:48:31.768063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 14/23] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:48:31 2022] GET /compute/v2.1/os-volumes/84cd5bfc-05c9-4ad1-8f5c-61413f8f3776 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:33.284738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6db56714-06be-47c8-b20f-83791b8782e4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: .version_select at 0x7f6c18cbedc0>, body: {"keypair": {"name": "tempest-keypair-559024651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/gRkEA0wILDh1NeDALGRxSf2dDFqGHSncIvXtkC5JpGhsIotUzojSNvKHG9lf321/2JGWTPfuE1GwqFJTe2M71opo7bLyou33SNJYZEXer/yE6dH8FwKpzdkue7pWcXQ=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:33.379464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-6db56714-06be-47c8-b20f-83791b8782e4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:33.403390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-6db56714-06be-47c8-b20f-83791b8782e4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for user 7f4991f9c6ca4fc99f756f75f9460808 and project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:33.571710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6db56714-06be-47c8-b20f-83791b8782e4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.627207 Aug 24 03:48:33.572757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 15/24] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:48:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:33.764174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:33.764765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:33.765117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:33.765551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:33.766119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:33.831934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.832665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.833253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.838017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:33.838659 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:33.839172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:33.893404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1632771428", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "networks": [{"uuid": "a2816c6b-5427-4c69-a900-7e4b9f6a1d6c"}]}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:33.981816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for project c993aed86aaf431495a2d1724218fa9b. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:34.001991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for user 0772f8b4306f4e239f075f7b1c13790f and project c993aed86aaf431495a2d1724218fa9b. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:34.021836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:34.033558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:34.161135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] validate_networks() for [('a2816c6b-5427-4c69-a900-7e4b9f6a1d6c', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:34.339708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3a109fcc-c5cd-4be4-9593-3e8d14c2f759 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.035902 Aug 24 03:48:34.341011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 10/25] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:34.354979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2d3d53a1-ec84-4126-8987-bb3a99321a49 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:34.356045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2d3d53a1-ec84-4126-8987-bb3a99321a49 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:34.627794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2d3d53a1-ec84-4126-8987-bb3a99321a49 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:34.675618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2d3d53a1-ec84-4126-8987-bb3a99321a49 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1222 microversion: 2.1 time: 0.325817 Aug 24 03:48:34.677469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 11/26] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:34 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1222 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:35.004672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1485047231", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:35.140382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] validate_networks() for [('36cb3bc8-9b57-4e0a-ae7e-6971cdae89f2', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:37.059301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:37.061977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:37.061977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:37.061977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:37.061977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:37.099380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:37.104378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:37.106607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.108122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:37.109001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:37.111479 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.154745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Getting quotas for project dacde99115e641439164fc91e75f2aa0. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:37.160417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Getting quotas for user 728c3f2735d6441b870cf146fbf084c0 and project dacde99115e641439164fc91e75f2aa0. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:37.182585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:37.191973 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:37.312889 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:37.313425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:37.313788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:37.315014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:37.315459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:37.338555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:37.339046 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:37.339490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.352622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:37.353148 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:37.353816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:37.400547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for project c993aed86aaf431495a2d1724218fa9b. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:37.408587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for user 0772f8b4306f4e239f075f7b1c13790f and project c993aed86aaf431495a2d1724218fa9b. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:37.475990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:37.478799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:37.482489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2929cf5a-8b0d-4ce5-a5fe-48089608f5f7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.762622 Aug 24 03:48:37.482489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 16/27] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:37.503536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f226d876-1ebf-4bee-84bb-94e115c27650 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:37.505112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f226d876-1ebf-4bee-84bb-94e115c27650 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:37.747724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f226d876-1ebf-4bee-84bb-94e115c27650 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:37.779002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f226d876-1ebf-4bee-84bb-94e115c27650 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1215 microversion: 2.1 time: 0.286971 Aug 24 03:48:37.780626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5f2cabbf-fc37-4c15-af78-057fe306748f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.779302 Aug 24 03:48:37.781598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 12/28] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:37.792141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 17/29] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:37 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:37.795741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9f8bb511-e6ef-4b62-99b6-5c5d8d5a5625 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:37.814745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9f8bb511-e6ef-4b62-99b6-5c5d8d5a5625 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:37.960252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9f8bb511-e6ef-4b62-99b6-5c5d8d5a5625 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:37.977793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9f8bb511-e6ef-4b62-99b6-5c5d8d5a5625 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1222 microversion: 2.1 time: 0.183512 Aug 24 03:48:37.986777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 13/30] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:37 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:38.651025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1248439925", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7017dfb2-6dc7-4b44-a632-2d85a8be9995"}], "security_groups": [{"name": "tempest-securitygroup--525657524"}], "key_name": "tempest-keypair-569282096", "user_data": "}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:38.812086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-250b948a-b90a-4f1a-8162-9bc7288b40dc tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:38.812862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-250b948a-b90a-4f1a-8162-9bc7288b40dc tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:38.938023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-250b948a-b90a-4f1a-8162-9bc7288b40dc tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:38.945378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] validate_networks() for [('7017dfb2-6dc7-4b44-a632-2d85a8be9995', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:38.949221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-250b948a-b90a-4f1a-8162-9bc7288b40dc tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1215 microversion: 2.1 time: 0.141273 Aug 24 03:48:38.965068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 14/31] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:38 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:39.005904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57016419-4478-45dd-86e4-1536931e3713 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:39.007485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-57016419-4478-45dd-86e4-1536931e3713 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:39.316881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-57016419-4478-45dd-86e4-1536931e3713 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:39.353029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-57016419-4478-45dd-86e4-1536931e3713 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1222 microversion: 2.1 time: 0.351326 Aug 24 03:48:39.353919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 15/32] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:38 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1222 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:39.973435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c205ffd3-f904-4d6c-8835-3b879d4b66de tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:39.977111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c205ffd3-f904-4d6c-8835-3b879d4b66de tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:40.319941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c205ffd3-f904-4d6c-8835-3b879d4b66de tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:40.333671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c205ffd3-f904-4d6c-8835-3b879d4b66de tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1215 microversion: 2.1 time: 0.364533 Aug 24 03:48:40.365582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 16/33] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:39 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1215 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:40.393144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:40.396609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:40.415804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:40.416599 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:40.417247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:40.420198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:40.420903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:40.421531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:40.752391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:40.769686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6651cde5-020b-4bd6-a2d2-341ba17a85e9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1226 microversion: 2.1 time: 0.381302 Aug 24 03:48:40.784034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 17/34] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:40 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1226 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:40.846114 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1171045285", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4327a85-5abe-481f-bda3-6ed236459f01"}], "security_groups": [{"name": "tempest-securitygroup--835164713"}], "key_name": "tempest-keypair-918565050", "user_data": "}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:41.215046 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] validate_networks() for [('c4327a85-5abe-481f-bda3-6ed236459f01', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:41.493567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:41.494096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:41.494234 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:41.494644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:41.495209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:41.521827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.521827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.521827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.521827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:41.522354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:41.522354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:41.548697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:41.556791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:41.573047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:41.576262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:41.919828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f4752d96-cafb-40e2-8971-675f90343bb5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.275402 Aug 24 03:48:41.935500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 18/35] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:41.973573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:41.974316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:42.015382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.015947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.019628 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.023547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.024902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.029394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.241061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:42.241890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:42.242554 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:42.243120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:42.243768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:42.264343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.264343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.264343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.270013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.271128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.273636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.323355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:42.330507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for user bd8d967d9ecb410ea47e130ac3c8b4a6 and project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:42.369237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:42.372063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:42.436244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:42.537685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-00e35eb7-0e39-45ba-842f-c3b76b388623 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1211 microversion: 2.1 time: 0.593965 Aug 24 03:48:42.544961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 19/36] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:41 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1211 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:42.565193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.579135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:42.611848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.612409 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.612863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.613679 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:42.614137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:42.614619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:42.649722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ab7a243a-a5ca-4923-99a9-8b97bc273cd7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.809913 Aug 24 03:48:42.653486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 18/37] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 24 03:48:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 03:48:42.665941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bcff9362-45d8-4d7b-9c37-d9182a4d5904 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.669157 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bcff9362-45d8-4d7b-9c37-d9182a4d5904 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:42.816277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bcff9362-45d8-4d7b-9c37-d9182a4d5904 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:42.831451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bcff9362-45d8-4d7b-9c37-d9182a4d5904 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1241 microversion: 2.1 time: 0.176180 Aug 24 03:48:42.835887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 19/38] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:42.846201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-51a2ed2f-a618-46b4-9b56-5bc0a0fdcd3a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:42.847453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-51a2ed2f-a618-46b4-9b56-5bc0a0fdcd3a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:43.125483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:43.174180 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f5f3293b-63ad-49f3-8eb1-ec62ee0b4b2a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1282 microversion: 2.1 time: 0.593555 Aug 24 03:48:43.177307 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 20/39] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1282 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:43.182203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-51a2ed2f-a618-46b4-9b56-5bc0a0fdcd3a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:43.205061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-51a2ed2f-a618-46b4-9b56-5bc0a0fdcd3a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:43.207991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-51a2ed2f-a618-46b4-9b56-5bc0a0fdcd3a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:43.212349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-51a2ed2f-a618-46b4-9b56-5bc0a0fdcd3a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1281 microversion: 2.20 time: 0.375215 Aug 24 03:48:43.220923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 20/40] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:42 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1281 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:43.566780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:43.583047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:43.612183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:43.626766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:43.626766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:43.626766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:43.626766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:43.627226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:43.738480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1495358734", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06073011-9116-4dec-b966-b8baeee066ed"}], "security_groups": [{"name": "tempest-securitygroup--1420041870"}], "key_name": "tempest-keypair-559024651", "user_data": "}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:44.521659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:44.558781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-672d4d2a-e190-447e-be75-d2fa4f223590 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1275 microversion: 2.1 time: 0.995577 Aug 24 03:48:44.574291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 21/41] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:43 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1275 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:44.588099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:44.591388 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:44.605241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.611047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.611743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.612672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.613314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.613909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.765888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] validate_networks() for [('06073011-9116-4dec-b966-b8baeee066ed', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:48:44.847731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:44.856826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-db22de03-a769-4be5-b17c-f98d0b31be5f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1245 microversion: 2.1 time: 0.292789 Aug 24 03:48:44.869654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 22/42] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:44 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1245 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:44.875028 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:44.879342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:44.890613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.891556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.895698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:44.895698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:44.895698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:44.895698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.785487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:45.800146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1d78a596-e839-41f2-bc14-c4ddcf26f5a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1280 microversion: 2.1 time: 0.928739 Aug 24 03:48:45.800701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 23/43] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:44 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1280 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:45.835682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:45.836320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:45.852356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.852894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.853422 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:45.854314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:45.854836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:45.855326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.014197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:46.031146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:46.032753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:46.041533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0b875927-b04c-4607-91dc-e5abfe98d4a6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1285 microversion: 2.20 time: 0.220013 Aug 24 03:48:46.044884 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 24/44] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:45 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:46.064557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:46.065246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:46.084562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.085064 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.097305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.100899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.104302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.107891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.694949 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:46.709959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e06b6ef7-9348-4001-9b39-298cbff8bfb3 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1273 microversion: 2.1 time: 0.659917 Aug 24 03:48:46.722635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 25/45] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:46 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1273 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:46.749765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:46.751888 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:46.766827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.767603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.768918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:46.784585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:46.787876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:46.791969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.116100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:47.129796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-973e4844-96c4-4370-afdc-e88a3306cd7c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1293 microversion: 2.1 time: 0.394139 Aug 24 03:48:47.139701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 26/46] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:46 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1293 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:47.156450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:47.157974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:47.172448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.172961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.173406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:47.174128 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:47.174593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:47.179726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.354899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:48.372499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5091eb4b-2169-4e70-839b-607858999455 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 1.229179 Aug 24 03:48:48.376476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 27/47] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:47 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:48.382296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:48:48.392603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:48:48.392873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:48.392971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:48:48.392971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:48:48.393131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:48.393210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:48:48.393295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.400483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.400986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.401423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.409265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.410044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.410778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.411379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.419370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.420291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.420831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.421340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.452736 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:48:48.468130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for user 7f4991f9c6ca4fc99f756f75f9460808 and project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:48:48.519071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:48:48.522290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:48:48.724422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-18b15bdb-5973-43af-b807-8b1d240f428a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.990616 Aug 24 03:48:48.733315 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 21/48] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:48:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 4994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:48:48.749714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:48.751970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:48.760032 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:48.791467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.797145 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.798009 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.811989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:48.813675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:48.814456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:48.939502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:48.950595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:48.952140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:48.953281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-30223057-f80f-40c5-a7d0-fe2c70260ada tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1333 microversion: 2.20 time: 0.575565 Aug 24 03:48:48.989487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 28/49] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:48 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1333 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:49.004416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.007408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:49.023687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.024968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.026547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.028326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.028812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.030857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.442523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.456788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-78dbbdc0-5142-46ed-a0a6-3579d19989e7 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1273 microversion: 2.1 time: 0.728561 Aug 24 03:48:49.457869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 22/50] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:48 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1273 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:49.462749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7e6869be-da05-4e3f-9b96-7897b912ff16 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.475184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7e6869be-da05-4e3f-9b96-7897b912ff16 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:49.549463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.561829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-60e9d05a-64b7-4a3e-8bdc-bc2377f8830e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1311 microversion: 2.1 time: 0.566115 Aug 24 03:48:49.563060 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 29/51] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:48 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1311 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:49.596729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7e6869be-da05-4e3f-9b96-7897b912ff16 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.605424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7e6869be-da05-4e3f-9b96-7897b912ff16 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1237 microversion: 2.1 time: 0.146223 Aug 24 03:48:49.606864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 23/52] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:49 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1237 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:49.628400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:49.637996 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:49.640384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.641077 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.641677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.642570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.643184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.643810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.646283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c98ae52-9a1c-49c4-bd7a-84247b52a2ac", "tag": "a6681857-8400-45a1-8c5c-4c531119c8f4"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:49.665216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.665925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.666584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.689276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Creating event network-changed:a6681857-8400-45a1-8c5c-4c531119c8f4 for instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac on hv-cinder-85425 Aug 24 03:48:49.690219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:48:49.690849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-906a479c-4bb1-4d90-941f-393bd564e8c3 req-3237add5-0d22-467b-84ca-bb1fb7c0d0ef service nova] Acquired lock "compute-rpcapi-router" {{(pid=127737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:48:49.692271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.693001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.693861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.702529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:49.703339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:49.703940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:49.718838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.compute.rpcapi [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:48:49.720140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] Releasing lock "compute-rpcapi-router" {{(pid=127737) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:48:49.739654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-96e4fb60-8bbf-4325-8181-ecf02d1dbb20 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175144 Aug 24 03:48:49.740775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 30/53] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:49.968711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:49.981295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9621864b-3fdf-43b9-901a-3a2376b89960 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.372972 Aug 24 03:48:49.982645 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 24/54] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:49 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:50.017204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.017925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:50.022370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:50.028821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.028821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.028821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.028821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.029239 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.038065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.183266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:50.192294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:50.194070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:50.195458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-685fa643-05b1-43d8-953c-8b6a0c8c4662 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1333 microversion: 2.20 time: 0.183592 Aug 24 03:48:50.196607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 31/55] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1333 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:50.485125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.487496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:50.523952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.532530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.533172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.536882 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.539984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.540464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.585154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.589026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:50.602679 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.603182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.604820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.607195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:50.609118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:50.610972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:50.776628 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:50.788753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-eac208d7-a650-4fa5-b33c-82ad25b6ccf0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1311 microversion: 2.1 time: 0.209719 Aug 24 03:48:50.797344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 32/56] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:50.802832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5b60d5b4-5d18-4fe5-8cc7-7d875c10c15e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:50.803802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5b60d5b4-5d18-4fe5-8cc7-7d875c10c15e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:51.049072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5b60d5b4-5d18-4fe5-8cc7-7d875c10c15e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.064138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5b60d5b4-5d18-4fe5-8cc7-7d875c10c15e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1237 microversion: 2.1 time: 0.265037 Aug 24 03:48:51.065353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 33/57] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1237 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:51.077718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:51.078614 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:51.109193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.112061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.112693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.116679 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.117329 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.121273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.240293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.254450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-434b924f-1724-4b89-8442-0b3b3853269d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.774754 Aug 24 03:48:51.271389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 25/58] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:50 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:51.386181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d0e70d-85fe-4bda-affc-1087593bb9a9", "tag": "41041e86-75dd-4f31-b356-afb7225b7f42"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:51.404392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.405088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.405702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.433578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Creating event network-changed:41041e86-75dd-4f31-b356-afb7225b7f42 for instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 on hv-cinder-85425 Aug 24 03:48:51.434486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127736) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 03:48:51.435113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-19ee3cf2-4362-4aac-a167-31ffbf678494 req-bd2e158d-0b49-4674-bba8-e9ab7dbd201e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127736) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 03:48:51.436864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.437665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.438476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.439608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.440374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.441194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.455504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.compute.rpcapi [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 03:48:51.457189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] Releasing lock "compute-rpcapi-router" {{(pid=127736) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 03:48:51.509766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0aed1be3-1902-4861-b795-4e88ba8c3aa3 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235369 Aug 24 03:48:51.512553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 26/59] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:48:51.530257 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:51.533763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:51.553908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.556017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.557995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.560355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:51.561971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:51.563360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:51.954094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.968483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.969236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.973387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:51.985136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3177dae1-ebe5-403d-871c-5e6079fddaf0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1341 microversion: 2.20 time: 0.469947 Aug 24 03:48:51.986441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8a1d8555-de03-45bd-8315-3da4798e892c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.919777 Aug 24 03:48:52.003078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 34/60] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:51 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:52.003583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 27/61] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:51 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1341 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:52.030529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.031639 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.059581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.060294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.060764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.061699 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.062315 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.063021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.088186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.089105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.101936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.102696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.103353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.104265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.107964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.108711 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.386627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.400799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dc29be4d-31b0-4b9a-8347-a6a17de23895 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1233 microversion: 2.1 time: 0.315706 Aug 24 03:48:52.401509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 35/62] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:52 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1233 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:52.413880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:52.414942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:52.428203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.446389 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.447192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.447744 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.448613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:52.449181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:52.449479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-92ff69ec-167a-4333-9e6a-59bf49a2a6c3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1299 microversion: 2.1 time: 0.433366 Aug 24 03:48:52.450710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:52.451420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 28/63] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:52 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1299 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:52.459941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.711201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:52.719523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-00e201c4-8bc8-47b3-8bd1-9af5c4b0892b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.316643 Aug 24 03:48:52.720099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 36/64] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:52 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:53.016458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.017222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.030232 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.030615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.031423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.031920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.033014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.033447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.045408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.045958 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.054392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.058115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.061562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.062571 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.063043 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.063476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.120464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.134068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.135784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.137120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f12b3ab6-e3e7-424f-80f9-3a183e507eb9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.124835 Aug 24 03:48:53.138274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 29/65] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:53.233195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.242187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-70561015-21ec-4f91-8b02-a10c7ba6307b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.214333 Aug 24 03:48:53.242775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 37/66] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:53.422728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.423340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.429941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.430464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.430907 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.431619 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.432072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.432496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.472036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.472665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.479756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.480246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.480713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.481423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.481877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.482339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.499883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.508874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a15084fe-d721-473d-ba94-32d15556a7ea tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1233 microversion: 2.1 time: 0.090175 Aug 24 03:48:53.512188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 30/67] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:53.554579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-ac6c44ac-0fa2-41a2-a194-1a22fdd12eef req-d7be493a-c5e6-4277-a189-2626b02f2bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83853dbd-24f1-49ec-9d58-9afd2906f68f", "tag": "ad8881c1-59ad-4043-9bc6-98fc8e597bc0"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:48:53.565211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ac6c44ac-0fa2-41a2-a194-1a22fdd12eef req-d7be493a-c5e6-4277-a189-2626b02f2bc6 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.565599 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ac6c44ac-0fa2-41a2-a194-1a22fdd12eef req-d7be493a-c5e6-4277-a189-2626b02f2bc6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.566026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ac6c44ac-0fa2-41a2-a194-1a22fdd12eef req-d7be493a-c5e6-4277-a189-2626b02f2bc6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.581402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-ac6c44ac-0fa2-41a2-a194-1a22fdd12eef req-d7be493a-c5e6-4277-a189-2626b02f2bc6 service nova] Creating event network-changed:ad8881c1-59ad-4043-9bc6-98fc8e597bc0 for instance 83853dbd-24f1-49ec-9d58-9afd2906f68f on hv-cinder-85425 Aug 24 03:48:53.588312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-ac6c44ac-0fa2-41a2-a194-1a22fdd12eef req-d7be493a-c5e6-4277-a189-2626b02f2bc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037277 Aug 24 03:48:53.588938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 31/68] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:48:53.623793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.632581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-92093e07-097d-495e-9390-76b1b769401e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.164474 Aug 24 03:48:53.633170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 38/69] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:53.742305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:53.743020 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:53.750641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.751132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.751573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.752277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:53.752758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:53.753154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:53.939605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:53.947992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7295d818-ecd0-4047-b3fb-ce09a4fc474e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.210468 Aug 24 03:48:53.948569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 32/70] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:53 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.161424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.165746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.168372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.168849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.169281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.169982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.170457 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.170882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.243346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.252971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.254516 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.255654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6625b24f-2e7d-4169-840e-db11a2be03e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.098691 Aug 24 03:48:54.256322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 39/71] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:54.264596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.264596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.270319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.270803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.271243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.272188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.272632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.273047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.422727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.431520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0886dd44-b932-45d9-89e5-54aa4879d9af tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.172306 Aug 24 03:48:54.432104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 33/72] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.533743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.534393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.541260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.541737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.542190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.542889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.543338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.543761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.606947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.614837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-21938527-738c-4859-a9dd-6d8a0a3211fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1233 microversion: 2.1 time: 0.084872 Aug 24 03:48:54.615475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 40/73] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:54.653871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.654513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.660658 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.661141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.661579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.662964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.663417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.663844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.806373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:54.814102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-08ff7b69-24a7-4f62-bb76-30fdf8edb0fa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.164176 Aug 24 03:48:54.814703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 34/74] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:54.971560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:54.971560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:54.977082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.977572 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.978074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:54.978811 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:54.979266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:54.979722 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.121437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.132023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-837c7173-a061-484e-8445-6ce59495e55f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.166516 Aug 24 03:48:55.133356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 41/75] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:54 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.278857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.279829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.286493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.287906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.288426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.289209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.290006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.290651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.359890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.369084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.371528 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.372828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dda727eb-1023-4411-bd3c-5971b2b5f370 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.097953 Aug 24 03:48:55.373558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 35/76] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:55.453404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.454007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.461254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.461649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.462084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.462825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.463271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.463688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.625924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.637018 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.637714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.644229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.644762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.645209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.645423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fdd67197-fd29-49ef-8c2b-395038920437 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.196002 Aug 24 03:48:55.645914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.647009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 42/77] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.647122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.647495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.723798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:55.733486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9c887c63-48d1-4bc8-ac7e-d13f2ebff6b8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1289 microversion: 2.1 time: 0.100941 Aug 24 03:48:55.736582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 36/78] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:55.836511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:55.837478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:55.843734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.844214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.844647 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:55.845550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:55.846108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:55.846562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.003158 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.012567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1afeb503-e005-44bc-8e1c-8f1a40bb8b40 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.181288 Aug 24 03:48:56.013633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 43/79] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:55 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:56.155693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.156359 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.169380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.182297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.182297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.182297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.182297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.182808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.353564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.374888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e2379e0d-b5bc-4ab8-9ac8-586ace2c9ca2 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.223265 Aug 24 03:48:56.376631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 37/80] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:56.403701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.404473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.421440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.421928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.422397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.423109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.423558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.424347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.496595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.505463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.508841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.510527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fa971573-3a19-4069-95b6-df34188e8582 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.117005 Aug 24 03:48:56.511423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 44/81] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:56.672923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.673678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.681206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.682444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.682444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.683105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.683628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.684125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.689598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:56.755052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:56.757000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:56.764111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.764530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.764957 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.765662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:56.766110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:56.766555 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:56.881938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.894900 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:56.899170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cb27fb7e-ff39-4292-b3b3-23cd51b072f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1289 microversion: 2.1 time: 0.148021 Aug 24 03:48:56.899813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 45/82] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:56.903622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-17654936-54c1-44d7-8ff0-0ad7bdc56cc9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.235726 Aug 24 03:48:56.914201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 38/83] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:56 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:57.034814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.035810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.042686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.043319 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.043864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.044996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.045247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.045773 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.200683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.208885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-264677df-d377-4678-b985-6ae7212bff43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.177875 Aug 24 03:48:57.218386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 46/84] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:57.397927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.399462 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.409959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.418509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.435907 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.441027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.441731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.442515 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.536396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.538308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.544960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.545758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.546859 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.547842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.548306 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.548902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.637910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.650486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.652248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.653398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0a58f0e4-640f-4b56-9acd-6b7d524eb351 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.121196 Aug 24 03:48:57.668662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 47/85] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:57.753356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:57.762573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ad64e583-24db-42ad-8320-6fa25d45025a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.369221 Aug 24 03:48:57.765420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 39/86] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:57.927895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.930876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:57.931847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.935882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:57.944966 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.945412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.945967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.946260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.946460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.947107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.947305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.948063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.948430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:57.948533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:57.949418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:57.950280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.072142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:58.080425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-51921c81-5b29-4090-9804-c727c6ab82f1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1289 microversion: 2.1 time: 0.161145 Aug 24 03:48:58.081225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 48/87] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1289 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:58.186174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:58.194629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d8279505-9ca8-4752-9612-5c90d3d0f042 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.270976 Aug 24 03:48:58.195264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 40/88] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:57 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:58.230050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.231461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.238219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.238685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.239116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.239850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.241399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.241972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.426563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:58.435375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-eb5bf36c-c633-49fd-8dec-393be5116a7b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.209493 Aug 24 03:48:58.435951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 49/89] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:58.681024 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.688884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.698472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.700169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.700954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.704802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.710026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.711031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.784959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:58.785818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:58.795453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.796266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.796937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:58.798091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:58.799169 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:58.799750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.072683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.083443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.085966 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.087544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-078a06d4-3ec6-478d-ac22-e71e569393a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.411241 Aug 24 03:48:59.088352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 41/90] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:48:59.110432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.111341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.118815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.119304 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.119740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.120443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.120894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.121470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.181931 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.191053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-559f7dc5-b252-4485-b691-f87666f85615 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.409941 Aug 24 03:48:59.194964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 50/91] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:58 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:59.216232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.217317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.224020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.225257 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.231730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.231910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.231910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.232106 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.232414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.237892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-21c25155-568a-4983-a5fc-6e6b5e109e12 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1289 microversion: 2.1 time: 0.139019 Aug 24 03:48:59.238507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 42/92] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:59 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1289 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:48:59.459041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:48:59.459927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:48:59.472210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.473055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.474929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.478546 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:48:59.479103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:48:59.479542 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:48:59.601995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=40 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:59.710612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.715779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=6 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:59.720789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ea52cd41-c23c-4ec5-8364-4b110dfa30c8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.508529 Aug 24 03:48:59.734740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 51/93] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:59 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:48:59.893871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:48:59.903967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-82ef0c9b-a519-40a2-b7cc-e01c6290b645 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.449816 Aug 24 03:48:59.905749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 43/94] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:48:59 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:00.116115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.118304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.136141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.154722 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.155183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.155936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.157856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.158816 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.218274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.219339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.253091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.260975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.266141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.266141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.267698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.269031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:00.270835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.277895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.293177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.299187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.305350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-38133c78-05b6-44de-a278-bff8c5c04034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1339 microversion: 2.20 time: 0.197485 Aug 24 03:49:00.321442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 52/95] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:00.321442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.321442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.338709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.346675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.346675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.346675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.346675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.347074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.497344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.510674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6598c518-9fc9-4b68-8052-8c5e84227789 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1297 microversion: 2.1 time: 0.202022 Aug 24 03:49:00.511517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 53/96] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1297 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:00.698686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.718269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-71dbfe29-5f66-473c-9a4d-8cf35199b73e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.496602 Aug 24 03:49:00.718269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 44/97] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:00.746371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.746938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.753212 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.753792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.754378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.755152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.756476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.756916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.899553 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:00.907637 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5fc29369-8840-4ae8-9ab2-4b450c5afc27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.165573 Aug 24 03:49:00.908533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 54/98] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:00.930402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:00.931033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:00.937118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.937605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.938045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.938785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.939267 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.939721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:00.978885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-06efc58c-1b0c-4874-ac29-07d49a39fcb0 req-91a3dcb3-b6c8-48f0-a948-54647a4415ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310ace7e-4d39-4d18-853d-8100b1de8bd3", "tag": "26bb2b47-4acd-4d88-9312-b50d50ebd4e7"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:00.989560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-06efc58c-1b0c-4874-ac29-07d49a39fcb0 req-91a3dcb3-b6c8-48f0-a948-54647a4415ab service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:00.991348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-06efc58c-1b0c-4874-ac29-07d49a39fcb0 req-91a3dcb3-b6c8-48f0-a948-54647a4415ab service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:00.991916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-06efc58c-1b0c-4874-ac29-07d49a39fcb0 req-91a3dcb3-b6c8-48f0-a948-54647a4415ab service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.005111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-06efc58c-1b0c-4874-ac29-07d49a39fcb0 req-91a3dcb3-b6c8-48f0-a948-54647a4415ab service nova] Creating event network-changed:26bb2b47-4acd-4d88-9312-b50d50ebd4e7 for instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 on hv-cinder-85425 Aug 24 03:49:01.010643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-06efc58c-1b0c-4874-ac29-07d49a39fcb0 req-91a3dcb3-b6c8-48f0-a948-54647a4415ab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036152 Aug 24 03:49:01.011545 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 55/99] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:01.080687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.089132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3e872eda-1510-4257-ba62-5e725d4fdeaa tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.165966 Aug 24 03:49:01.089718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 45/100] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:00 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:01.326630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=28 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:01.331285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.331996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.339654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.340182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.340650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.341359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.341803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.342252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.529943 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.533995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.535062 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.539787 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=10 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:01.542302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.544176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.546490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5cdf16b5-4f07-4351-9a1c-1b3e0841cfb6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.220568 Aug 24 03:49:01.548765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.549256 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.549844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.550793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.551053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 56/101] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:01.551780 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.552524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.621188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:01.635484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-35d0c0dd-4a58-4d97-9974-aa6afd7e204e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1307 microversion: 2.1 time: 0.105012 Aug 24 03:49:01.635484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 46/102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:01.730601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.731430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.740075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.740075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.740075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.740075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.740864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.741236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.931095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:01.942297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:01.947963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.948713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.949531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:01.950480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:01.951738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:01.952358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.047167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.061291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a1f42910-f143-4f4d-9f3b-a288197e3c76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.330016 Aug 24 03:49:02.061631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 57/103] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:02.109999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:02.111035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:02.126292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.128189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.129444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.130726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.131402 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.132055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.749992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.760942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a56c7ea7-d6a5-4283-bc28-77301408fbd9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.834704 Aug 24 03:49:02.761534 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 47/104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:01 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:02.767002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:02.767860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:02.778685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.781454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.781905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.782701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.783369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.783978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.814218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.827891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-54917875-61f3-476c-9a26-53dd288cca78 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.721420 Aug 24 03:49:02.828774 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 58/105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:02 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:02.833867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:02.834862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:02.847395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.847879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.848308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.849286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:02.850725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:02.850725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:02.968277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:02.977200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bb1a5450-d1a9-4070-9c5b-1ca1123189bb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1295 microversion: 2.1 time: 0.147187 Aug 24 03:49:02.978062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 59/106] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:02 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:03.060238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.069884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.071691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.072796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-86f9ba7b-44bb-4238-8e0f-31232f55ed0f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.309601 Aug 24 03:49:03.073370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 48/107] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:02 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:03.093697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.094553 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.103186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.104012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.104807 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.106032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.106776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.107404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.414566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:03.432261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a945d65a-e916-4ecb-bbc3-d492cef6b070 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.342767 Aug 24 03:49:03.435145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 60/108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:03.628283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-07570020-ea6e-4bea-a809-a87d6cc0be98 req-c514f6dc-334b-41cc-ae69-ef06fb2f19a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:03.645501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-07570020-ea6e-4bea-a809-a87d6cc0be98 req-c514f6dc-334b-41cc-ae69-ef06fb2f19a0 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.653669 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-07570020-ea6e-4bea-a809-a87d6cc0be98 req-c514f6dc-334b-41cc-ae69-ef06fb2f19a0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.655631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-07570020-ea6e-4bea-a809-a87d6cc0be98 req-c514f6dc-334b-41cc-ae69-ef06fb2f19a0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.681955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-07570020-ea6e-4bea-a809-a87d6cc0be98 req-c514f6dc-334b-41cc-ae69-ef06fb2f19a0 service nova] Creating event network-changed:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:49:03.687968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-07570020-ea6e-4bea-a809-a87d6cc0be98 req-c514f6dc-334b-41cc-ae69-ef06fb2f19a0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065520 Aug 24 03:49:03.690396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 49/109] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:03.792752 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.793895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.816421 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.817512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.818944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.820413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.821155 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.821891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.850833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:03.852403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:03.860039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.861009 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.861707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:03.865152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:03.867133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:03.872019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.266000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.276820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.285421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5d68c992-dc5e-4204-ae9b-63d10be37c15 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.440145 Aug 24 03:49:04.286017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 50/110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:04.291012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-98226cdc-5201-40f6-9fd4-15c698491273 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.511960 Aug 24 03:49:04.292071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 61/111] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:03 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:04.294602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.295519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.300442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.301518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.310610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.311481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.312141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.313138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.313844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.314693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.315964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.332810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.332810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.332810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.332810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.333830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.663748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.668617 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.672242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-166b8507-7f0c-4956-88a4-44b3c09c30ed tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.384361 Aug 24 03:49:04.672834 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 51/112] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:04.677981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:04.678876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:04.685130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.685596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.686026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.686804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:04.687256 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:04.687675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:04.695094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.697108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.698505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f1d36edc-53b5-4632-9ca3-81ec01aeba15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.405259 Aug 24 03:49:04.699603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 62/113] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:04.923717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:04.934833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b26d418c-1b58-4374-b42b-671ed22c89a8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.260874 Aug 24 03:49:04.935371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 52/114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:04 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:05.307887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.308811 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.314740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.315337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.316065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.316371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.316915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.318435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.319138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.319839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.326817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.329107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.329107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.329107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.329107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.330022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.603308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.616796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4d8e8719-b2d5-4d6b-9f71-d936791cbb98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.306489 Aug 24 03:49:05.617626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 53/115] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:05.633574 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.642391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-45c93102-4cdc-4627-8d5a-538c4eddbcb2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.338393 Aug 24 03:49:05.642959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 63/116] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:05.698905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.699648 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.705838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.706401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.713864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.713864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.713864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.713864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.722311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:05.722894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:05.729159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.729651 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.730078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.740149 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:05.740924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:05.741337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:05.985459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:05.998926 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7d959e42-89a8-493e-b04f-0f0a7eb7ddd6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.303855 Aug 24 03:49:05.999531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 54/117] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:06.017759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:06.030042 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:06.031789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:06.047075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2b5f6717-68ed-4d64-9e77-a98665fb6c8c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.314708 Aug 24 03:49:06.047075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 64/118] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:05 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:49:06.047075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.047075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.047075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.047867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.047867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.048616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.049538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.050221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.204314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-c2ed7563-e914-477a-8053-b0bdf220364c req-5b6dd670-214f-4880-b169-6f84af28c96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d0e70d-85fe-4bda-affc-1087593bb9a9", "name": "network-vif-plugged", "status": "completed", "tag": "41041e86-75dd-4f31-b356-afb7225b7f42"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:06.214687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-c2ed7563-e914-477a-8053-b0bdf220364c req-5b6dd670-214f-4880-b169-6f84af28c96f service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.215027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-c2ed7563-e914-477a-8053-b0bdf220364c req-5b6dd670-214f-4880-b169-6f84af28c96f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.215443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-c2ed7563-e914-477a-8053-b0bdf220364c req-5b6dd670-214f-4880-b169-6f84af28c96f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.217198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:06.226444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c3855563-80c3-49fc-8182-75e45a30c1db tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.191671 Aug 24 03:49:06.227294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 65/119] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:06.227697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-c2ed7563-e914-477a-8053-b0bdf220364c req-5b6dd670-214f-4880-b169-6f84af28c96f service nova] Creating event network-vif-plugged:41041e86-75dd-4f31-b356-afb7225b7f42 for instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 on hv-cinder-85425 Aug 24 03:49:06.232943 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-c2ed7563-e914-477a-8053-b0bdf220364c req-5b6dd670-214f-4880-b169-6f84af28c96f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229567 Aug 24 03:49:06.233808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 55/120] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:06.638268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.638878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.645144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.646272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.646718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.647591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.648046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.648470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.666258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:06.671654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:06.674036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.674593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.675036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.675743 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:06.676200 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:06.676622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:06.681852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:07.112055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.117502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d8b7d269-262b-4502-bc2d-fafa71c193b4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.483070 Aug 24 03:49:07.118098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 66/121] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:07.134029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.136536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:07.137187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:07.143828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.144318 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.144788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.145663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.146122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.146583 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.162267 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2a143521-ad59-4f7a-ab2e-829f4ac801f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.501040 Aug 24 03:49:07.162950 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 56/122] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:06 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:07.169399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:07.170253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:07.176546 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.177925 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.178390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.179105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.179704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.180862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.472134 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.482783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cbc1c1fc-08e5-41c1-a38b-c10f4e84d384 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.351034 Aug 24 03:49:07.485526 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 67/123] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:07 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:07.508480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-ef248de5-000d-43a9-9bc1-cd0c1daed67e req-2fc62f7d-0f2e-4ee9-946b-ed793f62a163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd163bb-cead-4664-bfcc-59aa1b1f920f", "tag": "86a4494f-cdb8-4299-a2f3-8e9d161bb68e"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:07.553627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ef248de5-000d-43a9-9bc1-cd0c1daed67e req-2fc62f7d-0f2e-4ee9-946b-ed793f62a163 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.556576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ef248de5-000d-43a9-9bc1-cd0c1daed67e req-2fc62f7d-0f2e-4ee9-946b-ed793f62a163 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.561454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ef248de5-000d-43a9-9bc1-cd0c1daed67e req-2fc62f7d-0f2e-4ee9-946b-ed793f62a163 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.595214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-ef248de5-000d-43a9-9bc1-cd0c1daed67e req-2fc62f7d-0f2e-4ee9-946b-ed793f62a163 service nova] Creating event network-changed:86a4494f-cdb8-4299-a2f3-8e9d161bb68e for instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f on hv-cinder-85425 Aug 24 03:49:07.605279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.607566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-ef248de5-000d-43a9-9bc1-cd0c1daed67e req-2fc62f7d-0f2e-4ee9-946b-ed793f62a163 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107192 Aug 24 03:49:07.608220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 68/124] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:07.620055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:07.625239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.625239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.625239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2a28097d-bffb-42f1-85dc-7910d8980252 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.459064 Aug 24 03:49:07.625591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 57/125] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:07 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:07.626551 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:07.634263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.634729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.635148 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.635848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:07.636287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:07.636874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:07.807295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:07.816431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d7bda789-5db1-4eda-8b0f-98138a82e76b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.205105 Aug 24 03:49:07.817046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 69/126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:07 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:08.142393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.143004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.149580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.150069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.150543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.151245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.151864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.152202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.184338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.185340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.196138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.197269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.197913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.198817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.199277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.199769 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.383725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.398144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aa332828-6f6d-4e55-a3e1-c38125b73809 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.259593 Aug 24 03:49:08.402127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 58/127] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:08.433031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.436837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:08.442293 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-48ae8ec3-5953-42d7-a794-23bb0c99514d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.261752 Aug 24 03:49:08.443426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 70/128] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:08.511420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.512489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.520044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.520663 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.521771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.522786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.523409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.523844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.649512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.650115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.656182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.656884 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.657287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.658170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.658776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.659240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.665769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.676161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0f67cfea-97a1-4116-9e8b-96ced39be3cb tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.168666 Aug 24 03:49:08.690694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 59/129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:08.817244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.827193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.828716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:08.829993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e73c3c7f-fbda-4412-9f77-f969258f3da8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.184973 Aug 24 03:49:08.832254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 71/130] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:49:08.839005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:08.839728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:08.847850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.847850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.847850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:08.849174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:08.850010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:08.850676 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.000960 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.011137 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0c37be2f-2117-4b68-8011-cb55d2de5015 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.177807 Aug 24 03:49:09.023570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 60/131] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:08 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:09.425112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:09.425839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:09.435428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.435650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.436195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.437149 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.441229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.441229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.465847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:09.467242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:09.474591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.475380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.476003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.477044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.477756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.478376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.642243 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.650713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-254e9518-21ea-4213-9155-8d150d15818e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.232703 Aug 24 03:49:09.651293 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 72/132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:09 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:09.671836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.680031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-df04b773-5c26-4d1d-a5b4-3d8e1ca12e20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.219963 Aug 24 03:49:09.680605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 61/133] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:09 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:09.700785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:09.701419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:09.717558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.717756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.718459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.719894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.720714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.721452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.859719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:09.860535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:09.870288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.870833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.872922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.879205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:09.879205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:09.879205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:09.939891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:09.958279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8ff5947c-ffc5-48b2-b998-4631ab0961b4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.261008 Aug 24 03:49:09.968658 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 73/134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:09 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:10.047077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.047077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.050037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.050875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.051561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.053672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.061360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.062478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.116247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.126298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.130887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.131920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4ef48018-0232-4f76-bb63-a07b94c5ec16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.276255 Aug 24 03:49:10.148668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 62/135] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:09 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:49:10.261971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:10.278298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-382e85c5-5a26-4ca6-90dd-c686b979963b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.246216 Aug 24 03:49:10.293714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 74/136] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:10.680563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-7e80838f-8290-407c-8fc8-483d4588fb59 req-4f3726f0-1d82-4ac4-8a47-e3cc5bc41d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c98ae52-9a1c-49c4-bd7a-84247b52a2ac", "name": "network-vif-plugged", "status": "completed", "tag": "a6681857-8400-45a1-8c5c-4c531119c8f4"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:10.681495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.681495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.681740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-7e80838f-8290-407c-8fc8-483d4588fb59 req-4f3726f0-1d82-4ac4-8a47-e3cc5bc41d7a service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.681740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-7e80838f-8290-407c-8fc8-483d4588fb59 req-4f3726f0-1d82-4ac4-8a47-e3cc5bc41d7a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.681740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-7e80838f-8290-407c-8fc8-483d4588fb59 req-4f3726f0-1d82-4ac4-8a47-e3cc5bc41d7a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.682135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.682790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.683280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.683992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.684451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.684867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.691102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-7e80838f-8290-407c-8fc8-483d4588fb59 req-4f3726f0-1d82-4ac4-8a47-e3cc5bc41d7a service nova] Creating event network-vif-plugged:a6681857-8400-45a1-8c5c-4c531119c8f4 for instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac on hv-cinder-85425 Aug 24 03:49:10.702493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-7e80838f-8290-407c-8fc8-483d4588fb59 req-4f3726f0-1d82-4ac4-8a47-e3cc5bc41d7a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036445 Aug 24 03:49:10.702493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 63/137] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:10.719652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:10.726802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:10.750365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.751385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.752496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:10.755603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:10.756687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:10.757866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.000105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.011245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d330bfbd-ae4e-46ca-b3ee-a52eeb0db505 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1322 microversion: 2.1 time: 0.341288 Aug 24 03:49:11.023118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 75/138] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:11.028625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:11.029249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:11.035933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.038414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.045414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.045873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.046803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.047495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.047929 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.060151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dec949b4-ff2a-478a-93bb-fd6e7e8fc014 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.359274 Aug 24 03:49:11.060685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 64/139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:10 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:11.168356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:11.169106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:11.182327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.182826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.183268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.184007 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.184467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.185021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.218937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.229403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-47e7da7d-2950-4341-9bc1-28ec5680f6f4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.205072 Aug 24 03:49:11.230011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 76/140] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:11 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:11.301029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:11.302372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:11.322745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.323954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.325921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.328150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:11.329607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:11.331524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:11.352700 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.365923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.375188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.377196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e4213404-7128-433f-9f52-eeee7a0841e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.225125 Aug 24 03:49:11.378221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 65/141] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:11 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:11.587074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:11.596400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-38beaeef-e946-45d9-8d78-1cb13ae4bf8d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.299968 Aug 24 03:49:11.596986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 77/142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:11 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:12.033984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.034781 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.055212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.055950 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.056402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.057115 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.057582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.057984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.088554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.090006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.098074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.099755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.100562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.101856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.102774 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.103228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.332035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:12.341432 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-50a13a32-3548-4694-8813-0e0ee3e9314d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.256846 Aug 24 03:49:12.343208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:12.352955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8b8af2d5-2c9f-4438-8a63-11e3a38f97e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1517 microversion: 2.1 time: 0.322765 Aug 24 03:49:12.355110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 78/143] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:12.356479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 66/144] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1517 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:12.361255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.362079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.371141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.371803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.372392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.373754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.375325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.375920 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.378839 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:12.381636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.388210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.388707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.389139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.389847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.390326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.390746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.481554 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'flavor' on Instance uuid 92d0e70d-85fe-4bda-affc-1087593bb9a9 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:12.598659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:12.608220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-90b5fe41-8d24-4f9b-933e-2a7bfbfa2211 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.252603 Aug 24 03:49:12.622465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 79/145] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:12.627713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.628623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.634736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:12.636473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.637214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.637863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.638799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.639446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.640052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.834641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:12.842956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:12.844443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:12.845743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0098502f-bd0d-49c5-8476-0102713a66c3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.221955 Aug 24 03:49:12.846440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 80/146] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:12.856736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.856736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:12.857929 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.858458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.858885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.859569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.860242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.860479 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.948929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c59dd872-b99e-44b0-8477-b3380d89ff5e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9/action" status: 200 len: 32 microversion: 2.1 time: 0.574248 Aug 24 03:49:12.950006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 67/147] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:49:12 2022] POST /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9/action => generated 32 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:49:12.955785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-eb49187c-d06c-415e-a275-ec9477db83c9 req-2b33ae44-1ce0-4d9b-8c1b-f8b73edc0bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310ace7e-4d39-4d18-853d-8100b1de8bd3", "name": "network-vif-plugged", "status": "completed", "tag": "26bb2b47-4acd-4d88-9312-b50d50ebd4e7"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:12.967026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-eb49187c-d06c-415e-a275-ec9477db83c9 req-2b33ae44-1ce0-4d9b-8c1b-f8b73edc0bf7 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:12.967510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-eb49187c-d06c-415e-a275-ec9477db83c9 req-2b33ae44-1ce0-4d9b-8c1b-f8b73edc0bf7 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:12.967939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-eb49187c-d06c-415e-a275-ec9477db83c9 req-2b33ae44-1ce0-4d9b-8c1b-f8b73edc0bf7 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:12.981467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-eb49187c-d06c-415e-a275-ec9477db83c9 req-2b33ae44-1ce0-4d9b-8c1b-f8b73edc0bf7 service nova] Creating event network-vif-plugged:26bb2b47-4acd-4d88-9312-b50d50ebd4e7 for instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 on hv-cinder-85425 Aug 24 03:49:12.986969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-eb49187c-d06c-415e-a275-ec9477db83c9 req-2b33ae44-1ce0-4d9b-8c1b-f8b73edc0bf7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035313 Aug 24 03:49:12.987757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 68/148] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:12.994203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:12.994906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:13.001105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.001612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.002038 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.003471 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.003471 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.003952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.009663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:13.017719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f860454a-0934-4cd2-a746-2f700d1f1046 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.170294 Aug 24 03:49:13.018310 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 81/149] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:13.146924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:13.155978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6ea1a47f-1a8b-4355-bc56-be054d41efee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.166573 Aug 24 03:49:13.160682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 69/150] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:12 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:13.369187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:13.370037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:13.376403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.377144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.377797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.378680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.379197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.380224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.585502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:13.593378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d3365a89-ac34-4d48-b5cd-49afb6b80087 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.230345 Aug 24 03:49:13.594501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 82/151] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:13 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:13.635349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:13.636806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:13.645526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.646908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.647510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.648402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.649467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.650067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.875522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:13.877939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:13.904692 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.914711 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.915549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.921878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:13.923103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:13.925154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:13.926103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:13.946563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f7285610-7c69-4b0d-ad59-fab31f119131 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.319861 Aug 24 03:49:13.949455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 70/152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:13 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:14.044058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.044935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.054998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:14.056695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.057436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.059335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.060362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.061031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.061741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.544699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.560497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.566939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.568706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3c8b6451-ea65-4680-9bc2-b825d131e527 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.700912 Aug 24 03:49:14.572279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 83/153] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:13 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:14.587863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.590420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.593769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.607052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.612258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aa0bd725-5bd5-420f-bedc-ab4aad5a8586 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.575051 Aug 24 03:49:14.619571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 71/154] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:14.621532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.622299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.623635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.626227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.627097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.629466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:14.640069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:14.654420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.654913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.655336 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.656044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:14.656490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:14.656909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:14.661323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:14.985570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:14.997296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ba105378-b317-4201-bd6b-e2b7ff0c7b35 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.423680 Aug 24 03:49:14.998264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 84/155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:15.003647 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.008662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.011603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:15.021029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.021546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.022290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-03a87495-854e-4028-af4b-5c052d45f535 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.400985 Aug 24 03:49:15.022881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.023695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.024624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.025056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.025274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 72/156] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:15.030916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "name": "network-vif-plugged", "status": "completed", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}, {"server_uuid": "83853dbd-24f1-49ec-9d58-9afd2906f68f", "name": "network-vif-plugged", "status": "completed", "tag": "ad8881c1-59ad-4043-9bc6-98fc8e597bc0"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:15.045694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.046613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.048692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.068102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] Creating event network-vif-plugged:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:49:15.068862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] Creating event network-vif-plugged:ad8881c1-59ad-4043-9bc6-98fc8e597bc0 for instance 83853dbd-24f1-49ec-9d58-9afd2906f68f on hv-cinder-85425 Aug 24 03:49:15.077774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-80882b82-b535-4983-a99d-5d76c26ddfd9 req-080025c7-b9e0-4c06-a9ad-f3b0ec2632db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050634 Aug 24 03:49:15.079126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 73/157] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:15.234127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:15.243832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-15cdb1e2-3239-47e4-b1b3-4799fc410a0f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.244348 Aug 24 03:49:15.244698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 85/158] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:14 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:15.592085 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.592937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.600559 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.601102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.601541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.602281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.603409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.603409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.639715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:15.643082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:15.655311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.655805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.656245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.658337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:15.664010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:15.664522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:15.999408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.014444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.014444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.014906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c1269e30-808e-4788-b283-b9a071cfe793 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.427530 Aug 24 03:49:16.015883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 74/159] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:15 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:16.028603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.028603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ac6432e0-ac6e-4840-98a4-aee8905e419d tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.392181 Aug 24 03:49:16.028603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 86/160] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:15 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:16.030546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:16.031466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.044503 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.051606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.052096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:16.052191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.052273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.052343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.052343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.052343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.053803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.054518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.055421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.056419 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.056946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.057827 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.075784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:16.323983 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.332096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5c4d2580-bfab-4977-9f62-5903aa9060d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.305069 Aug 24 03:49:16.338820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.344145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 87/161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:16 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:16.350964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ea8e33f4-60b4-4852-b4f7-ed4d8da6969e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1366 microversion: 2.1 time: 0.309957 Aug 24 03:49:16.363214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:16.363214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:16.363593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 75/162] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:16 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:16.363699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.364328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.364842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.365873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:16.366457 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:16.366814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:16.574705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:16.583225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3d132322-850b-4747-83d3-016c6b33405c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.235887 Aug 24 03:49:16.584741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 88/163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:16 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.053138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.059327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.060615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.066145 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.075458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.077838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.078311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.079024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.079476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.079906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.085699 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.086613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.087063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.087786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.088245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.088671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.349419 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.352389 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.359452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.360484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3f0bc22c-8ad5-4327-9306-d87f1fa874e8 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.315940 Aug 24 03:49:17.361074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 89/164] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.361185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.362391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7d605744-80fc-4f0a-a4d4-5e3822b9b818 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.325484 Aug 24 03:49:17.362950 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 76/165] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:17.368691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.369312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.375511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.389299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.389299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.389299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.389652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-194b5c4a-68da-4a98-b2bb-2506fe909243 req-0fb99c0e-9e46-4801-b5cb-2bf93e06e4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd163bb-cead-4664-bfcc-59aa1b1f920f", "name": "network-vif-plugged", "status": "completed", "tag": "86a4494f-cdb8-4299-a2f3-8e9d161bb68e"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:17.389758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.389758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.389907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-194b5c4a-68da-4a98-b2bb-2506fe909243 req-0fb99c0e-9e46-4801-b5cb-2bf93e06e4f0 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.389907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-194b5c4a-68da-4a98-b2bb-2506fe909243 req-0fb99c0e-9e46-4801-b5cb-2bf93e06e4f0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.390129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-194b5c4a-68da-4a98-b2bb-2506fe909243 req-0fb99c0e-9e46-4801-b5cb-2bf93e06e4f0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.402680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-194b5c4a-68da-4a98-b2bb-2506fe909243 req-0fb99c0e-9e46-4801-b5cb-2bf93e06e4f0 service nova] Creating event network-vif-plugged:86a4494f-cdb8-4299-a2f3-8e9d161bb68e for instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f on hv-cinder-85425 Aug 24 03:49:17.407977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-194b5c4a-68da-4a98-b2bb-2506fe909243 req-0fb99c0e-9e46-4801-b5cb-2bf93e06e4f0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039754 Aug 24 03:49:17.409035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 90/166] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:17.414606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.418070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.425531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.425531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.425531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.425531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.427159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.427159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.581124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.590292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-adbf15b7-9ca7-4147-8881-03368e4003d5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.226009 Aug 24 03:49:17.603268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 77/167] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.609618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.610310 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.613504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.622343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-163e0a29-f3b1-4c23-af6b-95d3469db382 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1557 microversion: 2.1 time: 0.211837 Aug 24 03:49:17.622781 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.623478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 91/168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1557 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:17.623588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.624032 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.624745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.625197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.625625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.651805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:17.652393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:17.658970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.659644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.660231 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.661230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:17.662010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:17.662496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:17.849956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-68b01caa-11b7-4f2c-906a-8df715cd2ec7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201891 Aug 24 03:49:17.851389 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 92/169] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:17.894202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:17.906105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5bdffa2b-6e5d-405e-9d0b-73307d6eb14b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.301225 Aug 24 03:49:17.906975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 78/170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:17 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:18.389390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.390133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.391354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.392047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.405346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.417093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.418999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.419640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.423318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.423769 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.424448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.425128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.426110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.427375 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.428088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.430261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.669367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:18.672630 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:18.681996 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:18.683372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-832c1b49-9073-4e41-a0bc-20cd4c49edd0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.301882 Aug 24 03:49:18.683518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:18.684012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 93/171] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:18.684653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5625e5b3-9485-4fd4-b4d2-7e1dc26a2128 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.299191 Aug 24 03:49:18.690675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 79/172] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:49:18.691198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.692460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.704721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.705311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.705855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.708837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.709619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.710264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.873003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:18.881397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3b82481f-f6a9-4c05-be33-399d680b5519 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.196321 Aug 24 03:49:18.882225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 94/173] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:18.928461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:18.929297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:18.936211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.936710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.937328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:18.938082 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:18.938597 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:18.939078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.125968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.134956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7dbcad4d-8eca-469a-a2c9-92a74eafaf6a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.211484 Aug 24 03:49:19.135842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 80/174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:18 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:19.711373 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:19.712017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:19.712426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:19.712517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:19.718538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.718851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.719353 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.719601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.719790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.720194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.720637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.720902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:19.721093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.721356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:19.721551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.721779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:19.962888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.972268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.973873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:19.980179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cc87ddf1-10e9-4192-a54c-aff55bf9c620 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1406 microversion: 2.20 time: 0.273161 Aug 24 03:49:19.983016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 81/175] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:19 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:19.988844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-adf56f04-2854-4ed1-90c3-6068b3056081 req-0ce1d81b-5efa-4c1a-9500-2ee47a6fc63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310ace7e-4d39-4d18-853d-8100b1de8bd3", "tag": "26bb2b47-4acd-4d88-9312-b50d50ebd4e7"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:20.001115 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-adf56f04-2854-4ed1-90c3-6068b3056081 req-0ce1d81b-5efa-4c1a-9500-2ee47a6fc63b service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.001637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-adf56f04-2854-4ed1-90c3-6068b3056081 req-0ce1d81b-5efa-4c1a-9500-2ee47a6fc63b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.002071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-adf56f04-2854-4ed1-90c3-6068b3056081 req-0ce1d81b-5efa-4c1a-9500-2ee47a6fc63b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.015480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-adf56f04-2854-4ed1-90c3-6068b3056081 req-0ce1d81b-5efa-4c1a-9500-2ee47a6fc63b service nova] Creating event network-changed:26bb2b47-4acd-4d88-9312-b50d50ebd4e7 for instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 on hv-cinder-85425 Aug 24 03:49:20.019560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:20.032790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bd9a2b74-f05c-44d7-a71a-2a4fc7bfa558 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.325933 Aug 24 03:49:20.034523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-adf56f04-2854-4ed1-90c3-6068b3056081 req-0ce1d81b-5efa-4c1a-9500-2ee47a6fc63b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049860 Aug 24 03:49:20.034903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 95/176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:19 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:20.040969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:20.042059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:20.049610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 82/177] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:20.052539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.052635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.053006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.053763 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.054641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.055081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.157168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:20.158611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:20.166171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.166929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.167372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.168073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:20.169085 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:20.169586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:20.322186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:20.333999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-aa15c2b0-9b0c-49f3-8dcf-c5ee9b722502 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.297510 Aug 24 03:49:20.334974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 96/178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:20 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:20.381440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:20.390389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2a3ba43c-2260-47d3-899f-ad8d94f882f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.237639 Aug 24 03:49:20.391296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 83/179] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:20 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:21.009181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.009889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.017318 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.017907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.018381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.019977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.019977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.020255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.065093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.065952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.095408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.096022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.096726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.097640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.098370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.099293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.252820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.263103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.264631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.265848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e7da66d1-3a4f-4800-b78b-3f7405bf5081 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1596 microversion: 2.20 time: 0.263342 Aug 24 03:49:21.266431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 97/180] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1596 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:49:21.294961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.296324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.304282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.304771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.305205 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.306451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.306552 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:21.306652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.306923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.314981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5d11b6ef-3326-4d5c-b677-c073a813e45a tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.262504 Aug 24 03:49:21.315562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 84/181] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:21.357219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.357826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.364896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.365938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.366450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.367172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.367629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.368083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.402759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3f2e120b-4067-4456-9238-2728850482f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113538 Aug 24 03:49:21.403423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 98/182] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:49:21.414624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:21.415506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:21.423742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.424447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.425072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:21.426974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:21.427681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:21.428271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.003775 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:22.013174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-51d50250-e0e1-4605-9346-b8cfe94f46f5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.660137 Aug 24 03:49:22.013761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 85/183] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:22.061684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:22.071101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-92a5cd38-f767-4366-9843-5536e59a720b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.661909 Aug 24 03:49:22.071689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 99/184] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:21 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:22.335852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:22.336648 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:22.342652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.343128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.343568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.344270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:22.344722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:22.345158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:22.554789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:22.564035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ea2d70c7-fc6b-4919-b66b-dc576df9ba8f tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.232904 Aug 24 03:49:22.570274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 86/185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:22 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.035440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:23.036304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:23.042750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.043237 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.043672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.044378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.044825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.045248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.092364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:23.093001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:23.104934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.105590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.106128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.106969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.107662 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.108331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.265752 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.274127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fc9550dc-3f47-484b-840a-d2bdb9c252ad tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.242701 Aug 24 03:49:23.274881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 100/186] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:23 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.279698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-ed740a04-758d-49cb-957a-020649a1431e req-20eb392f-11f7-4907-b95c-a98414a434d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:23.292698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ed740a04-758d-49cb-957a-020649a1431e req-20eb392f-11f7-4907-b95c-a98414a434d7 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.293294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ed740a04-758d-49cb-957a-020649a1431e req-20eb392f-11f7-4907-b95c-a98414a434d7 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.293823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ed740a04-758d-49cb-957a-020649a1431e req-20eb392f-11f7-4907-b95c-a98414a434d7 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.306444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-ed740a04-758d-49cb-957a-020649a1431e req-20eb392f-11f7-4907-b95c-a98414a434d7 service nova] Creating event network-changed:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:49:23.308156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.312277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-ed740a04-758d-49cb-957a-020649a1431e req-20eb392f-11f7-4907-b95c-a98414a434d7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035897 Aug 24 03:49:23.313008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 101/187] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:23.318355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b00f28fe-fdb5-4d5c-b108-78f937ca3d85 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.229702 Aug 24 03:49:23.318955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 87/188] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:23 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:23.587419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:23.588385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:23.594915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.595410 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.595856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.596565 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:23.597835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:23.597835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:23.745115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:23.753404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7bea76a8-d3f3-4dad-9d79-86051d556326 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.170955 Aug 24 03:49:23.754006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 102/189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:23 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:24.295890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.296493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.303809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.304424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.304859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.305559 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.306005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.306485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.338782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.339506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.346111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.346723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.347171 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.348362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.348993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.349581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.515650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:24.524879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-71f985ba-6fb5-43d6-98f8-7d586215ff68 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.232794 Aug 24 03:49:24.525591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 88/190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:24.560309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:24.569214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-38da73c3-7c40-4074-9a82-364c9ce96ca8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.233673 Aug 24 03:49:24.570822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 103/191] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:24.786212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:24.786901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:24.793211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.793727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.794258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.794970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:24.795424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:24.795855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:24.936425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:24.945379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d19f53a8-25b6-40a1-ab81-63d3e0445710 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.163650 Aug 24 03:49:24.945964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 89/192] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:24 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:25.548161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.549260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.555669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.556150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.556769 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.557482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.557932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.558387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.592513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.593178 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.603867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.603867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.603867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.603867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.604221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.604221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.608913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.769460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:25.778486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0f4a53ca-e9b9-4c16-9d5b-55bf55f5859f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.234921 Aug 24 03:49:25.779170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 104/193] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:25.794553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:25.802430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c4432d86-c1de-4912-b4c7-b42437b12b82 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.214086 Aug 24 03:49:25.802997 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 90/194] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:25.966977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:25.967594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:25.974709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.975197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.975637 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:25.976359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:25.976810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:25.977238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.121595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:26.129483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a20d9913-dc08-4ae3-99be-cf5f7bcac481 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.166452 Aug 24 03:49:26.130437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 105/195] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:25 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:26.799982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:26.800594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:26.807637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.808150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.808588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.809294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.809751 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.810255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.823344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:26.824135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:26.831155 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.831647 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.832757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.833479 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:26.833941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:26.838746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:26.839150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:27.034495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:27.036655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:27.044953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2f851955-c930-4a6f-ab88-8c03c9046e86 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.249479 Aug 24 03:49:27.046796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 91/196] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:26 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:27.056104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-53f23116-108d-4fe8-bc98-6a48b33ed7cf tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.236551 Aug 24 03:49:27.056775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 106/197] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:26 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:27.151220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:27.151941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:27.158351 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.159004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.159629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.160238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:27.160689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:27.161325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:27.297629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:27.307057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-468b76b6-673d-470a-a953-9d1e9af9c4af tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.159563 Aug 24 03:49:27.307642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 92/198] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:27 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:28.068946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:28.069577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:28.076102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.076591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.077145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.077853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.078119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:28.078612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.078800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:28.078894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.086872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.086872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.086872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.086872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.087551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.087551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.499978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.504279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.515781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6b5b9b34-6f71-43ad-a363-7d01c3bc7d62 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.448460 Aug 24 03:49:28.515874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f0ddd597-58be-487e-a73b-6dc9f603ac1e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.439339 Aug 24 03:49:28.515951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 107/199] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:28 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:28.519204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:28.520387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:28.520976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 93/200] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:28 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:28.527477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.528209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.538605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.538605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:28.538605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:28.538605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:28.670416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:28.678502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3ddc500c-a00a-412f-94b2-8122555aa5e1 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1315 microversion: 2.1 time: 0.163103 Aug 24 03:49:28.679081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 108/201] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:28 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:29.535441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:29.536084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:29.536424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:29.537017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:29.542402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.542898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.543315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.543442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.543833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.544050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.544266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.544491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.544923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.545026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.545491 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.545916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.776947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:29.784690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0b40123a-4db6-446f-b097-d4e672cd2c7a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.253719 Aug 24 03:49:29.786301 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 94/202] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:29 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:29.791961 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:29.792569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:29.799355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.799355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.799773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.800466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:29.801512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:29.802282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:29.810324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:29.823052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c59d8201-ac44-46fb-8968-ac53cd955abd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.290961 Aug 24 03:49:29.827634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 109/203] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:29 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:29.952680 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:29.962328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-15193b03-19bc-49e5-969f-4d55d2136670 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1502 microversion: 2.1 time: 0.174815 Aug 24 03:49:29.963390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 95/204] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:29 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:30.807879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:30.808496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:30.814519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:30.814996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:30.815424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:30.816119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:30.817439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:30.818058 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:30.852841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:30.853441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:30.859711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:30.860199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:30.860717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:30.861592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:30.862042 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:30.862615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:31.010866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:31.025468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0a59078a-acb6-431b-876f-9abe08cbf8cc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.216814 Aug 24 03:49:31.025468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 110/205] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:30 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:31.085489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:31.106426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cf381065-2c62-4f9e-8022-596a8842e0f7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.257407 Aug 24 03:49:31.107045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 96/206] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:30 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:32.046966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:32.047779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:32.054570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.055061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.055496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.056207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.056992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.057424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.130429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:32.131161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:32.137203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.137833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.140078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.140078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:32.140930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:32.142539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:32.358803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:32.369079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2b45e9f0-9a75-41ba-8b20-531422f15e17 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.327847 Aug 24 03:49:32.369860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 111/207] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:32 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:32.406568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:32.419008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e1e0779f-0144-4ef6-9b47-c0b9479fe891 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1363 microversion: 2.1 time: 0.293058 Aug 24 03:49:32.419836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 97/208] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:32 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:33.391904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:33.392551 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:33.400236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.400766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.401206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.401921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.402450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.402879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.440573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:33.441832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:33.448464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.455631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.455631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.455631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.455631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.455969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.602788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:33.619522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b0c37414-f3d9-46d7-9e7a-406682713ae8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.231721 Aug 24 03:49:33.620217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 112/209] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:33 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:33.641655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:33.647624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-df431a11-b48b-488c-9dd6-0bdd6db1085f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1549 microversion: 2.1 time: 0.210785 Aug 24 03:49:33.648221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 98/210] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:33 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1549 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:33.670040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:33.670654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:33.677533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.678017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.678490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.679186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:33.679640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:33.680068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:33.767263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-92367d3b-24b0-48d9-935b-a3ace9dd0ba9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101003 Aug 24 03:49:33.767863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 113/211] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:49:33 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:34.402589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b09876cf-6927-4cf1-802b-8cc3956ed4fd"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:34.412291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:34.417965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.418535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.418973 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.419894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.420984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.421844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.650952 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:34.653350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:34.662225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.662987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.667776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.668542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:34.669005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:34.669437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:34.905969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:34.915533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c4975706-b2f4-4f0c-b977-5efd21397b9f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.272712 Aug 24 03:49:34.916501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 114/212] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:34 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:34.997768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-c74ab588-6f33-4547-b4c2-f041ad700e87 req-de3db55b-510f-4259-9b2f-06468091b62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd163bb-cead-4664-bfcc-59aa1b1f920f", "tag": "86a4494f-cdb8-4299-a2f3-8e9d161bb68e"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:35.007822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c74ab588-6f33-4547-b4c2-f041ad700e87 req-de3db55b-510f-4259-9b2f-06468091b62c service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.008298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c74ab588-6f33-4547-b4c2-f041ad700e87 req-de3db55b-510f-4259-9b2f-06468091b62c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.008724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c74ab588-6f33-4547-b4c2-f041ad700e87 req-de3db55b-510f-4259-9b2f-06468091b62c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:35.021939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-c74ab588-6f33-4547-b4c2-f041ad700e87 req-de3db55b-510f-4259-9b2f-06468091b62c service nova] Creating event network-changed:86a4494f-cdb8-4299-a2f3-8e9d161bb68e for instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f on hv-cinder-85425 Aug 24 03:49:35.036213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-c74ab588-6f33-4547-b4c2-f041ad700e87 req-de3db55b-510f-4259-9b2f-06468091b62c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041852 Aug 24 03:49:35.036749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 115/213] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:49:35.707269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6b5c3474-8d9e-44cb-8817-e526c452bcf9 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "POST /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.311105 Aug 24 03:49:35.708723 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 99/214] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:49:34 2022] POST /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f/os-volume_attachments => generated 194 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:35.949114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:35.949114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:35.959316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.959700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.960142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:35.960976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:35.961457 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:35.962186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:36.138957 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:36.148200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a7d410cc-ea23-472c-bfc6-2c7c93032d6f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.207852 Aug 24 03:49:36.149289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 116/215] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:35 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:37.175742 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:37.176368 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:37.184379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:37.184965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:37.185506 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:37.186365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:37.186934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:37.187471 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:37.326682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:37.335335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-19301815-f7eb-4bf0-b89a-0cfd18d61ab3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.165467 Aug 24 03:49:37.337571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 100/216] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:37 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:38.357723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:38.358399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:38.366290 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:38.366779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:38.367264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:38.368015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:38.368468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:38.369251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:38.507351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:38.515334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-30f9143f-f8bf-4e2e-b48f-95f9dd2cc475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.162050 Aug 24 03:49:38.515981 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 117/217] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:38 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:39.538376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:39.538990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:39.545371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:39.545924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:39.546393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:39.547090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:39.547538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:39.547962 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:39.695052 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:39.704422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1c62cbd8-876b-4635-ab2a-e6252535fd27 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.171991 Aug 24 03:49:39.718683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 101/218] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:39 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:40.727924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:40.728500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:40.734524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.735001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.735429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:40.736123 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:40.736565 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:40.736987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:40.884855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:40.893915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a1cb3fea-c8e7-4c82-81be-375671816348 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.169707 Aug 24 03:49:40.895403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 118/219] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:40 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:41.916596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:41.917190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:41.923702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:41.924177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:41.924627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:41.925877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:41.926625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:41.927051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:42.065140 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:42.074004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-966fc20f-ed21-4cbe-903a-3470de4e5792 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.161264 Aug 24 03:49:42.074601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 102/220] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:41 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:43.094801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:43.095574 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:43.109453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:43.109936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:43.110413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.111127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:43.111578 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:43.112008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:43.257273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:43.265836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dc6b8814-a2f6-4a07-84a5-69fd708e2dfb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.174866 Aug 24 03:49:43.280003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 119/221] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:43 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:44.288797 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:44.288797 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:44.295327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:44.295885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:44.296328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:44.297026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:44.297475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:44.297897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:44.451477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:44.474525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a225ed18-75df-4cc9-a960-99b676d5b6b7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.176539 Aug 24 03:49:44.474525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 103/222] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:44 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:45.482676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:45.483428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:45.485563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=79 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.493768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:45.493768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:45.493768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:45.493768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:45.494112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:45.494359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:45.634088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:45.642990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e3d522f4-dd82-4ee9-a590-b41c00b633b2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.163974 Aug 24 03:49:45.643568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 120/223] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:45 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:46.665653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:46.666303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:46.669305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=65 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.674945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:46.675436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:46.676708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:46.677766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:46.678250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:46.678674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:46.827458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:46.836435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a989e943-2eeb-4bdc-9f98-01365703b306 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.175701 Aug 24 03:49:46.837050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 104/224] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:46 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:47.858249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:47.858860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:47.865802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:47.866322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:47.866764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:47.867468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:47.868014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:47.869241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:48.009807 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:48.017715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ba728428-e7e3-4b1b-97d4-e4d8d3bc78bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.163421 Aug 24 03:49:48.018806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 121/225] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:47 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:49.040866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:49.041474 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:49.047942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.048425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.048862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.049600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:49.050054 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:49.050513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:49.069820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:49.188841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:49.196804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d9ac9b25-e4f4-4311-9eee-3139b29a8d24 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.159895 Aug 24 03:49:49.197413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 105/226] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:49 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:50.218260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:50.218871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:50.225570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.226048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.226520 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.227219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:50.227671 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:50.228097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:50.367811 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:50.375959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7366c2a3-151d-47ed-89dc-86346491d243 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.161533 Aug 24 03:49:50.376537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 122/227] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:50 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:51.397579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:51.398302 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:51.405649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.407167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.407657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.408376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.408827 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.409254 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.557287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:51.565259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-80c65efe-d5b3-4bb6-9b69-c172427240c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.171810 Aug 24 03:49:51.565838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 106/228] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:51 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:51.838487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:51.839046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:51.844883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.845360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.845793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.846513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:51.846965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:51.847381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:51.874099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:49:51.879129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.357063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b066e38d-5ea9-4fcc-9fe5-a40ba2fcce76 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "DELETE /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 204 len: 0 microversion: 2.1 time: 0.522270 Aug 24 03:49:52.357659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 123/229] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:49:51 2022] DELETE /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:49:52.366724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:52.367460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:52.374117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:52.374644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:52.375074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:52.375778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:52.376227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:52.376655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:52.528664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:52.539347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7febb5b9-8785-4aab-870c-10f0eef42333 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1554 microversion: 2.1 time: 0.177322 Aug 24 03:49:52.539945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 107/230] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:52 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:52.591008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:52.595105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:52.600362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:52.600864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:52.601336 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:52.602183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:52.603020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:52.603686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:52.769047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:52.778262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a25d9d02-5e12-460e-bb1e-41be048748b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.191370 Aug 24 03:49:52.778877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 124/231] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:52 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:53.562180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:53.562919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:53.569784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.570297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.571026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.571761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.572203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.572621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.735003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:53.745724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-da5fe0c4-3355-459c-91aa-750c036e4cc6 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1554 microversion: 2.1 time: 0.188572 Aug 24 03:49:53.746327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 108/232] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:53 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:53.800956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:53.802531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:53.809234 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.809733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.810187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.818620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:53.818620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:53.818620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:53.951474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:53.960241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7bbddff0-e609-4bdd-bb98-00d77bb500cd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.163238 Aug 24 03:49:53.960831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 125/233] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:53 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:54.767525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:54.768127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:54.775280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:54.776507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:54.776507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:54.776918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:54.777372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:54.777800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:54.917380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:54.926548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-36305e7c-11f7-4ac6-86af-66d90a5f9525 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1554 microversion: 2.1 time: 0.162323 Aug 24 03:49:54.927220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 109/234] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:54 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:54.983275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:54.983785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:54.990653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:54.991134 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:54.991575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:54.992270 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:54.992725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:54.993150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:55.156531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:55.165459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2cad4557-10bf-4c50-a5ba-e110e154f1db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.187026 Aug 24 03:49:55.166678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 126/235] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:54 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:55.948616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:55.949282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:55.956386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:55.956702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:55.958008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:55.958988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:55.959439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:55.959864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.103818 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:56.112867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7cdf8efc-e26c-437a-85ef-1fbf8253688b tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1554 microversion: 2.1 time: 0.168805 Aug 24 03:49:56.113542 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 110/236] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:55 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:56.187886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:56.188512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:56.195080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.195661 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.196140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.196842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:56.197301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:56.197730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:56.326830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:56.335399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b46be8cd-4dac-41fd-93fe-0d7d6c507247 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.151371 Aug 24 03:49:56.336025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 127/237] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:56 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:57.135196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:57.135811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:57.142478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.142974 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.143413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.144209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.144635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.145253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.359322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:57.360454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:57.369437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.370340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.382262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.383007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.383109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:57.383892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.384464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.395737 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-197024bf-114d-4d56-95e9-c3f12020ed75 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1554 microversion: 2.1 time: 0.263522 Aug 24 03:49:57.397004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 111/238] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:57 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:57.402086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-7f1c4d2c-9303-492e-8a42-e4549949007f req-3aff3bf2-3306-48d6-bd04-a59254dd56de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83853dbd-24f1-49ec-9d58-9afd2906f68f", "name": "network-vif-deleted", "tag": "ad8881c1-59ad-4043-9bc6-98fc8e597bc0"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:49:57.415047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-7f1c4d2c-9303-492e-8a42-e4549949007f req-3aff3bf2-3306-48d6-bd04-a59254dd56de service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:57.415530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-7f1c4d2c-9303-492e-8a42-e4549949007f req-3aff3bf2-3306-48d6-bd04-a59254dd56de service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:57.415955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-7f1c4d2c-9303-492e-8a42-e4549949007f req-3aff3bf2-3306-48d6-bd04-a59254dd56de service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:57.436473 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-7f1c4d2c-9303-492e-8a42-e4549949007f req-3aff3bf2-3306-48d6-bd04-a59254dd56de service nova] Creating event network-vif-deleted:ad8881c1-59ad-4043-9bc6-98fc8e597bc0 for instance 83853dbd-24f1-49ec-9d58-9afd2906f68f on hv-cinder-85425 Aug 24 03:49:57.445266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-7f1c4d2c-9303-492e-8a42-e4549949007f req-3aff3bf2-3306-48d6-bd04-a59254dd56de service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045372 Aug 24 03:49:57.446308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 112/239] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:49:57.562734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:57.571812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cf5e3ba3-f3d0-4ea1-ada9-a0a9f43e8ed9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.217681 Aug 24 03:49:57.572206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 128/240] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:57 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:58.420117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:58.420906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:58.430223 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.430890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.431658 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.432685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.433817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.434400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.475803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.476378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.476932 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.477486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lazy-loading 'fault' on Instance uuid 83853dbd-24f1-49ec-9d58-9afd2906f68f {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:58.528750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:58.537914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-861ad1b2-2e31-448f-b4c7-4e1193ee9d5e tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1351 microversion: 2.1 time: 0.123953 Aug 24 03:49:58.538893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 113/241] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:58 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:58.593063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:58.593675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:58.601115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.601830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.602490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.603194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:58.603641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:58.604066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:58.750803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:58.759521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-374c3cc2-5af4-4c68-bbbe-acd86bde37ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.170499 Aug 24 03:49:58.760066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 129/242] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:58 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:49:59.559571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:59.564536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:59.567466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.567952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.568382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.569074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.569519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.569937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.604459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.604940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.605373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.605824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lazy-loading 'fault' on Instance uuid 83853dbd-24f1-49ec-9d58-9afd2906f68f {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:49:59.656923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728c3f2735d6441b870cf146fbf084c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dacde99115e641439164fc91e75f2aa0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:59.665672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8e46f63d-cf37-4259-91c6-87411d22f492 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 200 len: 1351 microversion: 2.1 time: 0.110142 Aug 24 03:49:59.666492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 114/243] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:59 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:49:59.781663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:49:59.782229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:49:59.789468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.789962 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.790643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.791355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:49:59.791813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:49:59.792261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:49:59.929825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:49:59.938896 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6f126887-9d49-4267-ba65-ca3905b9b203 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.161449 Aug 24 03:49:59.939649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 130/244] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:49:59 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:00.690779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:00.692084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:00.698896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.699381 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.699818 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.700553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.701035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.701456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.715807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] HTTP exception thrown: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Request method failure captured: Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f HTTP/1.1 Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-RB-xQh5RcP3TRgp8gU2gWWQNbl2hwEBpdH-9Fo1ZdZCfKnYHu9IBJO1Y1b26DGlqI5E5M2jGPQ0QdJ9kvmHxVdgHVWTuhYz4BRKj-LWwQubm--FnZewGCsvkylb2HBGEr9Z66ZwMOzsh2MFwJ4GrFj9beQPevjf9AIMv5DsRqRUQ Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:50:00.723560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dacde99115e641439164fc91e75f2aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 728c3f2735d6441b870cf146fbf084c0 Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.725220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '83853dbd-24f1-49ec-9d58-9afd2906f68f'} Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:00.726045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.727481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.729187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Returning 404 to user: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:00.729187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-53601f43-1622-4ced-860b-f76b55339e19 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 404 len: 111 microversion: 2.1 time: 0.038085 Aug 24 03:50:00.729187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 115/245] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:00 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:00.861680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:00.865109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:00.871166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.871649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.872093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.872792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.873247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.873677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.887262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] HTTP exception thrown: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Request method failure captured: Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f/os-volume_attachments HTTP/1.1 Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-RB-xQh5RcP3TRgp8gU2gWWQNbl2hwEBpdH-9Fo1ZdZCfKnYHu9IBJO1Y1b26DGlqI5E5M2jGPQ0QdJ9kvmHxVdgHVWTuhYz4BRKj-LWwQubm--FnZewGCsvkylb2HBGEr9Z66ZwMOzsh2MFwJ4GrFj9beQPevjf9AIMv5DsRqRUQ Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:50:00.891620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dacde99115e641439164fc91e75f2aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 728c3f2735d6441b870cf146fbf084c0 Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.893206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'server_id': '83853dbd-24f1-49ec-9d58-9afd2906f68f'} Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:00.893910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:00.895322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:00.896405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Returning 404 to user: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:00.896405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e27160c9-4cd3-4ded-93d6-12adf1b9b401 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035394 Aug 24 03:50:00.896405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 131/246] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:50:00 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:00.961635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:00.962262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:00.968806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.969293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.969897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:00.974722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:00.974722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:00.974722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:01.120674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:01.130230 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c9717c33-8a12-49d4-b385-11dad3fb3506 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.173738 Aug 24 03:50:01.130995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 116/247] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:00 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:02.166200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.166914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:02.172971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.176838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.176838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.176838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.176838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.177241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.557486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:02.559061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.559915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:02.565240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-09b20717-9c84-4279-9b0e-830425e80a4b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.403421 Aug 24 03:50:02.566563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 132/248] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:02 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:02.569536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.570090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.570609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.572117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.572778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.573380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.590057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] HTTP exception thrown: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Request method failure captured: Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: DELETE /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f HTTP/1.1 Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-RB-xQh5RcP3TRgp8gU2gWWQNbl2hwEBpdH-9Fo1ZdZCfKnYHu9IBJO1Y1b26DGlqI5E5M2jGPQ0QdJ9kvmHxVdgHVWTuhYz4BRKj-LWwQubm--FnZewGCsvkylb2HBGEr9Z66ZwMOzsh2MFwJ4GrFj9beQPevjf9AIMv5DsRqRUQ Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:50:02.591686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dacde99115e641439164fc91e75f2aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 728c3f2735d6441b870cf146fbf084c0 Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.593076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '83853dbd-24f1-49ec-9d58-9afd2906f68f'} Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:02.593912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.595494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.596881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Returning 404 to user: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:02.596881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0dfe5b6c-e929-43cb-8bcd-1c0368851db0 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "DELETE /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 404 len: 111 microversion: 2.1 time: 0.039193 Aug 24 03:50:02.596881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 117/249] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:50:02 2022] DELETE /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:50:02.603560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:02.604256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] [instance: 83853dbd-24f1-49ec-9d58-9afd2906f68f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:02.614252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.614252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.614252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.614252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:02.614618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:02.614618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:02.628346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] HTTP exception thrown: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Request method failure captured: Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f HTTP/1.1 Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-RB-xQh5RcP3TRgp8gU2gWWQNbl2hwEBpdH-9Fo1ZdZCfKnYHu9IBJO1Y1b26DGlqI5E5M2jGPQ0QdJ9kvmHxVdgHVWTuhYz4BRKj-LWwQubm--FnZewGCsvkylb2HBGEr9Z66ZwMOzsh2MFwJ4GrFj9beQPevjf9AIMv5DsRqRUQ Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:50:02.631295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dacde99115e641439164fc91e75f2aa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dacde99115e641439164fc91e75f2aa0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: dacde99115e641439164fc91e75f2aa0 Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-DeleteServersTestJSON-456471528 Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 728c3f2735d6441b870cf146fbf084c0 Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-DeleteServersTestJSON-456471528-project Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.637803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '83853dbd-24f1-49ec-9d58-9afd2906f68f'} Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:02.639081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. Aug 24 03:50:02.640494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:50:02.641674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] Returning 404 to user: Instance 83853dbd-24f1-49ec-9d58-9afd2906f68f could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:02.641674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9677c0c2-042d-45f3-babf-f66ff2cd4b94 tempest-DeleteServersTestJSON-456471528 tempest-DeleteServersTestJSON-456471528-project] 10.222.0.65 "GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f" status: 404 len: 111 microversion: 2.1 time: 0.033450 Aug 24 03:50:02.641674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 133/250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:02 2022] GET /compute/v2.1/servers/83853dbd-24f1-49ec-9d58-9afd2906f68f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:03.590504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:03.591278 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:03.599122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.599509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.600201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.601007 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:03.601818 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:03.602372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:03.775070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:03.782908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-419ef3b0-36fe-4a57-abf4-84c9a1a087c3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.196811 Aug 24 03:50:03.796825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 118/251] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:03 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:04.804192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:04.804809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:04.811549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:04.812398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:04.813007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:04.813712 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:04.814190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:04.814617 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:05.029152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:05.038909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-45225cc9-5c2c-4c27-8ce4-06f44606abc6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.238794 Aug 24 03:50:05.042671 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 134/252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:04 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:06.066217 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:06.068810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:06.077173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:06.077651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:06.078090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:06.078857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:06.079315 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:06.079767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:06.233970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:06.242604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b2049c9d-a0c0-482c-84dc-675dedd221ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.181238 Aug 24 03:50:06.244192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 119/253] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:06 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:07.264661 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:07.265472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:07.271996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:07.272555 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:07.273118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:07.274000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:07.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:07.274901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:07.539610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:07.550137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a4dfc373-b689-4d9b-b4ce-016c9d057479 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.289259 Aug 24 03:50:07.551532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 135/254] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:07 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:08.584405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:08.585987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:08.599945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:08.600568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:08.601366 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:08.602192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:08.602700 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:08.603174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:08.772443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:08.780992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-70d59a0b-c5ff-4ede-9cfb-fe1a0158e982 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.205587 Aug 24 03:50:08.781423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 120/255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:08 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:09.804777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:09.806010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:09.812343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:09.812832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:09.813273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:09.814328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:09.814793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:09.815234 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:09.974118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:09.982478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-77ee26ee-359e-4f37-91fa-55da5bbf875c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.182433 Aug 24 03:50:09.983041 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 136/256] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:09 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:11.005833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:11.006547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:11.013467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:11.014274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:11.014732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:11.015442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:11.015894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:11.016321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:11.184537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:11.192773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-991cd0bf-8579-4dbb-b1b7-5dc6710507f3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.191418 Aug 24 03:50:11.207295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 121/257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:11 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:12.215992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:12.216758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:12.223382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.223911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.224372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:12.231976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:12.231976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:12.231976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:12.370941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:12.379031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6c3c8f2b-5e65-40e4-baa2-d95a9ebc1fb2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.168013 Aug 24 03:50:12.379608 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 137/258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:12 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:13.400070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:13.400674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:13.415563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:13.415563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:13.415563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:13.415563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:13.416749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:13.416749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:13.550081 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:13.558113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e35f3208-23e5-438c-8353-e206dc275560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.161840 Aug 24 03:50:13.558704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 122/259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:13 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:14.579361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:14.579966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:14.586314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:14.586798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:14.587232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:14.587926 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:14.588372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:14.588789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:14.743198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:14.751405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2f022afd-bfc7-4935-b719-d5444de9a6e7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.175993 Aug 24 03:50:14.752214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 138/260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:14 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:15.773270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:15.774068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:15.780759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.781509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.781677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.782611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:15.783062 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:15.783488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:15.805490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:15.953582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:15.964881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4d85ecba-ab45-42f0-a6f2-de555b8a74c1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1523 microversion: 2.1 time: 0.195886 Aug 24 03:50:15.967135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 123/261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:15 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:16.988595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:16.989206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:16.991315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:16.996215 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:16.996701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:16.997143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:16.997848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.003513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.003513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.186433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:17.198195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a94140ef-a871-42f6-b2eb-61515189ab41 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1503 microversion: 2.1 time: 0.212461 Aug 24 03:50:17.199435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 139/262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:16 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:17.226076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:17.227539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:17.234544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=44 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:17.236951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.238845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.239633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.247151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:17.247151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:17.247151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:17.395856 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:17.403976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-da2f47f2-743d-460a-ad0e-70472dc49d57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1516 microversion: 2.1 time: 0.182764 Aug 24 03:50:17.404893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 124/263] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:17 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:20.679131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:20.685200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:20.696866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.697665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.698341 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.699601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:20.700230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:20.700822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:20.707068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:20.728900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'flavor' on Instance uuid 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:50:21.210372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-64028b81-1516-4f8b-aa80-1ec0fbecb475 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/action" status: 200 len: 32 microversion: 2.1 time: 0.538693 Aug 24 03:50:21.211348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 140/264] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:50:20 2022] POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/action => generated 32 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:50:21.225388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:21.230499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:21.244276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.245281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.246071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.250208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:21.250874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:21.251460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:21.819343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:21.858540 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2612be71-3676-498c-b1b5-1b645159c39e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.638782 Aug 24 03:50:21.864428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 125/265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:21 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:22.886441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:22.887266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:22.916032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.916032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.916032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:22.916032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:22.916540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:22.916540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:23.072439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:23.080336 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4da10260-a5be-4398-8584-4111980d3171 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.199093 Aug 24 03:50:23.081414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 141/266] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:22 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:24.103219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:24.103906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:24.113881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:24.113881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:24.114438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:24.115362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:24.115974 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:24.116577 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:24.266392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:24.276177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bf9801d5-c831-47a2-9266-be1e3a4a1831 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.176743 Aug 24 03:50:24.294364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 126/267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:24 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:24.654912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1217089534", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "networks": [{"uuid": "669e757e-aac3-47cd-bcd1-cfc4cc29b424"}]}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:24.710585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] validate_networks() for [('669e757e-aac3-47cd-bcd1-cfc4cc29b424', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:25.103761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:25.104265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:25.105001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:25.105554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:25.106168 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:25.117162 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.117712 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.118072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.118827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.119279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.119701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.137233 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Getting quotas for project 46f646fe435e4aa2954af01070537ae4. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:25.141992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Getting quotas for user 5247fd6c30794dc48f60a827d5837674 and project 46f646fe435e4aa2954af01070537ae4. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:25.153380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:25.155834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:25.308706 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:25.309726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:25.329538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-122d4b27-69cc-4d2c-8001-c129255c7002 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678566 Aug 24 03:50:25.331896 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 142/268] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:50:25.341028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.341730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.342206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.343044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:25.343599 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:25.344074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:25.345030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-838f9959-be30-4ddc-a15b-069d7c638316 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:25.352512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-838f9959-be30-4ddc-a15b-069d7c638316 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:25.474207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-838f9959-be30-4ddc-a15b-069d7c638316 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:25.484242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-838f9959-be30-4ddc-a15b-069d7c638316 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1219 microversion: 2.1 time: 0.145006 Aug 24 03:50:25.490937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 143/269] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:25 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:25.584610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:25.603983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9b00f2ca-b10d-4889-aa57-51db3f06986a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.304962 Aug 24 03:50:25.605793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 127/270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:25 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:26.507547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3bf23677-5105-42ec-b9e8-b9a3fb2027a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:26.512959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3bf23677-5105-42ec-b9e8-b9a3fb2027a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:26.568432 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3bf23677-5105-42ec-b9e8-b9a3fb2027a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:26.576450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3bf23677-5105-42ec-b9e8-b9a3fb2027a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1219 microversion: 2.1 time: 0.072589 Aug 24 03:50:26.577298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 144/271] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:26 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:26.629511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:26.630700 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:26.638530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:26.639356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:26.639998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:26.640836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:26.641298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:26.641720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:26.788281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:26.796489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fd98fc77-b741-4528-80cd-48a1d04b778c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.172244 Aug 24 03:50:26.797070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 128/272] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:26 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:27.600186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:27.601466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:27.608296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.613570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.613570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.613570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.613570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.613931 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.724286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:27.745826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-031931ca-0e28-4b79-97a3-1550e61f6631 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1215 microversion: 2.1 time: 0.144212 Aug 24 03:50:27.745826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 145/273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:27 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:27.818933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:27.819667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:27.826770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.827253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.827684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.828388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:27.828836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:27.829324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:27.984534 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:27.993431 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a281db2d-9d5d-4d52-8f45-2c7dc9065611 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.178782 Aug 24 03:50:27.994444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 129/274] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:27 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:28.761020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:28.761762 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:28.768445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.769085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.769523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.770248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:28.770709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:28.771133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:28.835131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:28.842742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b16be3ee-ba3e-4633-9384-ddb84220f291 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1271 microversion: 2.1 time: 0.085621 Aug 24 03:50:28.843313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 146/275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:28 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:29.015617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:29.016318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:29.024163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.024727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.025175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.025877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.026354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.030241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.382734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:29.387807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-709888a8-8632-4b71-8213-fd3c8b2c4b7b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.376084 Aug 24 03:50:29.388244 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 130/276] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:29 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:29.863816 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:29.864496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:29.870482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.870970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.871416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:29.872112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:29.872565 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:29.872994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.096157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:30.104763 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8951a71e-1c18-4ee7-b2a6-252485b5d857 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.245618 Aug 24 03:50:30.105321 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 147/277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:29 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:30.409092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:30.410320 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:30.417416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:30.418229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:30.418869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.431219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:30.431219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:30.431580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:30.643250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:30.651146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-67c94cfe-56c9-40d4-ae89-3e1dee2fb310 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.246021 Aug 24 03:50:30.651773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 131/278] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:30 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:31.035027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-bd6a1c19-b985-4b95-9a96-53dc6a36e37c req-6e84d706-70ee-4c2f-8602-2cbd6821b754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ca1d53-be5a-4c9d-8891-0b2735dd8b24", "tag": "4342b9d5-2129-4d9b-83db-ff7d31afd4e2"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:31.048034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-bd6a1c19-b985-4b95-9a96-53dc6a36e37c req-6e84d706-70ee-4c2f-8602-2cbd6821b754 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.048522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-bd6a1c19-b985-4b95-9a96-53dc6a36e37c req-6e84d706-70ee-4c2f-8602-2cbd6821b754 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.048955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-bd6a1c19-b985-4b95-9a96-53dc6a36e37c req-6e84d706-70ee-4c2f-8602-2cbd6821b754 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.063960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-bd6a1c19-b985-4b95-9a96-53dc6a36e37c req-6e84d706-70ee-4c2f-8602-2cbd6821b754 service nova] Creating event network-changed:4342b9d5-2129-4d9b-83db-ff7d31afd4e2 for instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 on hv-cinder-85425 Aug 24 03:50:31.068840 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-bd6a1c19-b985-4b95-9a96-53dc6a36e37c req-6e84d706-70ee-4c2f-8602-2cbd6821b754 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038476 Aug 24 03:50:31.069904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 148/279] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:31.131911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:31.132918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:31.139488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.140242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.140862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.141376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.141825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.142527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.381341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:31.389198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0d07ac48-3c7e-43f5-9bff-b2556bb3214a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.264932 Aug 24 03:50:31.389935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 132/280] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:31 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:31.674525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:31.676029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:31.684584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.685615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.686129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.687389 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:31.687940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:31.688440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:31.931802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:31.940270 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-01054270-e6aa-4da4-8f4c-6e0e8d13a6b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.270854 Aug 24 03:50:31.942330 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 149/281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:31 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:32.411899 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:32.412660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:32.419499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.419991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.420428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.421392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.421576 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.422183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.602833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:32.612887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-57213ead-9f51-4440-9056-e988c1f1f852 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.205624 Aug 24 03:50:32.613749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 133/282] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:32 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:32.966601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:32.967244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:32.973636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.974122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.974581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:32.975281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:32.975733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:32.976156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:33.125152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:33.133655 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4cdcf28b-983e-485c-bc42-dd80d197f610 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.171176 Aug 24 03:50:33.134255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 150/283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:32 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:33.635191 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:33.635805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:33.642329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:33.642822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:33.643260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:33.643957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:33.644415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:33.644893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:33.781772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:33.790371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-db306586-5059-4911-838b-78d8e111f7f8 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.159089 Aug 24 03:50:33.790965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 134/284] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:33 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:34.155560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.156207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:34.163757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.164272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.164712 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.165482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.165937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.166416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.332118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:34.340903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-890331a3-3693-452b-973e-d31cd25bbd57 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.189238 Aug 24 03:50:34.341499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 151/285] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:34 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:34.814189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:34.814805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:34.821479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.822020 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.822442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.823154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:34.823611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:34.824039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:34.965908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:34.973886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1345a28c-cdc8-4532-9f01-95ccb4dfe341 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.165290 Aug 24 03:50:34.974543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 135/286] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:34 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:35.365917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.366545 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:35.368474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:35.373150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:35.373627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:35.374058 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:35.374765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:35.375212 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:35.375631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:35.515146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:35.526749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-84dabe13-b2a4-442d-8186-6077f8264560 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.165618 Aug 24 03:50:35.527335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 152/287] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:35 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:35.995253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:35.995867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:36.002545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:36.003037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:36.004165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:36.004878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:36.005338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:36.005877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:36.148367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:36.156445 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-95c3e5d0-ea21-4740-aa21-a200f3c635da tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.164977 Aug 24 03:50:36.157013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 136/288] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:35 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:36.547784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:36.550668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:36.554517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:36.555003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:36.555468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:36.556170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:36.556620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:36.557038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:36.572591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=10 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:36.702688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:36.711181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-698bf7a3-6e7b-445b-9dea-3c3b076c324a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.167256 Aug 24 03:50:36.711754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 153/289] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:36 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:37.180045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:37.180865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:37.189569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:37.190054 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:37.190520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:37.191794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:37.192297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:37.192697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:37.631729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:37.640098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8bdd4b3a-f3c5-4281-85b1-7bd338982fcb tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.465320 Aug 24 03:50:37.640717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 137/290] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:37 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:37.732596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:37.733317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:37.741050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:37.741658 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:37.742241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:37.743020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:37.744050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:37.744504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:37.894818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:37.902786 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-22632f5f-25d3-47a9-aae2-7a4a7fdb75ff tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.174138 Aug 24 03:50:37.903362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 154/291] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:37 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:38.663865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:38.665340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:38.671446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.671997 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.672465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.673344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.673842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.674334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.828366 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:38.838167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3725b25c-324c-400b-b762-30ea9fc7900a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.178444 Aug 24 03:50:38.838972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 138/292] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:38 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:38.924127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:38.925585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:38.932107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.932594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.933026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:38.933727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:38.934197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:38.934626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.091197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:39.099646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-71db0dcb-b3a5-4b08-816c-8cdde14a5201 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.179523 Aug 24 03:50:39.101372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 155/293] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:38 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:39.861056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:39.861705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:39.869064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.869538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.869967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:39.870688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:39.871136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:39.871553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.017037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:40.025651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aeb31b97-da85-4414-9d62-49d3307b53aa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.168961 Aug 24 03:50:40.026246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 139/294] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:39 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:40.133684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:40.133684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:40.133684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.133684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.134599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.134599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:40.134599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:40.134599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:40.277615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:40.285600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-413e87c4-d3f3-416a-b9d8-4292329556ca tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.168419 Aug 24 03:50:40.286196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 156/295] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:40 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:41.052020 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:41.060121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:41.060121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.060423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.060694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.061487 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.061965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.062462 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.067548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:41.240131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:41.254872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-baa49bb9-0c64-4987-87fc-929c6a06dd4c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.206744 Aug 24 03:50:41.255794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 140/296] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:41 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:41.310472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:41.311636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:41.322935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.323456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.323972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.324702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.325159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.325590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.493792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:41.504964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8f22926d-a863-4a17-bb4f-55181d1fa56c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.200686 Aug 24 03:50:41.505729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 157/297] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:41 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:41.530201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:41.531125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:41.538325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.539143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.539579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.540285 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.540756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.541178 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.568640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-45304f6d-0401-4af2-b718-303b213c040e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/ips" status: 200 len: 151 microversion: 2.1 time: 0.042601 Aug 24 03:50:41.569139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 141/298] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:50:41 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:41.797680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-9a1dae6a-a625-40da-9679-a55174479f16 req-af8175a4-c959-4837-98b2-1b15f7248a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ca1d53-be5a-4c9d-8891-0b2735dd8b24", "name": "network-vif-plugged", "status": "completed", "tag": "4342b9d5-2129-4d9b-83db-ff7d31afd4e2"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:41.813782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-9a1dae6a-a625-40da-9679-a55174479f16 req-af8175a4-c959-4837-98b2-1b15f7248a93 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:41.814501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-9a1dae6a-a625-40da-9679-a55174479f16 req-af8175a4-c959-4837-98b2-1b15f7248a93 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:41.815074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-9a1dae6a-a625-40da-9679-a55174479f16 req-af8175a4-c959-4837-98b2-1b15f7248a93 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:41.820435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:41.830339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-9a1dae6a-a625-40da-9679-a55174479f16 req-af8175a4-c959-4837-98b2-1b15f7248a93 service nova] Creating event network-vif-plugged:4342b9d5-2129-4d9b-83db-ff7d31afd4e2 for instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 on hv-cinder-85425 Aug 24 03:50:41.837248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-9a1dae6a-a625-40da-9679-a55174479f16 req-af8175a4-c959-4837-98b2-1b15f7248a93 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043796 Aug 24 03:50:41.838429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 158/299] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:42.280099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:42.280712 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:42.288180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.288664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.289112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.289851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.290279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.290703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.530918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:42.532335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:42.566182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.567972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.569299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.570842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:42.574388 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:42.575084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:42.609306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:42.626106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3b537b44-4f75-4b68-a511-ad728dc62ef9 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.346349 Aug 24 03:50:42.640269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 142/300] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:42 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:42.779198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:42.793007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-be51e221-0cd7-4a4d-8df3-20b9133cf422 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.269385 Aug 24 03:50:42.794105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 159/301] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:42 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:43.650618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:43.651446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:43.660940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.661522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.661956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.662710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.663426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.663852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.809788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:43.818804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4db903eb-78ca-45c0-abb5-34e86ba3c274 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.173388 Aug 24 03:50:43.819383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 143/302] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:43 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:43.820258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:43.821341 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:43.831672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.832446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.833476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.834677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:43.835459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:43.836181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:43.992734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:44.000275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-37b4f243-a7d8-4703-b845-242ea987a998 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.188892 Aug 24 03:50:44.000834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 160/303] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:43 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:44.616843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b966af59-a662-4d46-b19f-1a9f038786fc"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:44.619324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:44.629615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.630421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.630861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.631563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.632222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.632709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.843904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:44.844518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:44.850718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.851204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.851639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:44.852330 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:44.852786 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:44.853210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.188269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:45.197015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-50bb610b-182f-4824-926d-f4756aedad19 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1319 microversion: 2.1 time: 0.357282 Aug 24 03:50:45.197641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 161/304] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:44 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:45.206420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:45.207137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:45.218568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.218568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.218568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.218568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.219015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.219102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.372898 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:45.381466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-198f3f11-b039-4259-a053-f08b1fbdac3e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.182390 Aug 24 03:50:45.382226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 162/305] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:45 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:45.387414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:45.387907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:45.394869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.395701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.396283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.398026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:45.398860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:45.399434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:45.426140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c116fc7e-237c-4c6f-b0d2-98852c837b29 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/ips" status: 200 len: 150 microversion: 2.20 time: 0.042710 Aug 24 03:50:45.426784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 163/306] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 24 03:50:45 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:50:46.219189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:46.220689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:46.228094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.228636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.229072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.229762 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.230324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.245768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.434025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:46.443927 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f10bd5ce-1429-4be0-8eb4-49a37f0cd6f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1508 microversion: 2.1 time: 0.230176 Aug 24 03:50:46.444595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 164/307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:46 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:46.457165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:46.458885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:46.468507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.469072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.469512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.470995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:46.472849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:46.473492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:46.627056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:46.635666 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e537eea0-25bd-474c-93cc-55b7e8f34463 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.183747 Aug 24 03:50:46.636231 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 165/308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:46 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:47.019475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-271f69a9-655c-44b1-bae6-d64a530e4c46 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.407119 Aug 24 03:50:47.025106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 144/309] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:50:44 2022] POST /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments => generated 194 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:50:47.658137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:47.658800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:47.665249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.665817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.666447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.667304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:47.667837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:47.668352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:47.859565 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:47.870333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1b0e7423-c91c-4931-a92f-08bbba9a4868 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.214550 Aug 24 03:50:47.886199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 166/310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:47 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:48.892464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:48.893146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:48.901977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:48.902510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:48.902951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:48.903714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:48.904176 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:48.904613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.088967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:49.089661 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:49.090963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.095980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.096755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.097303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.098023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.098506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.098948 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.099325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f24aa4a7-348a-46b8-8617-d0d10e86b969 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.211617 Aug 24 03:50:49.099916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 145/311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:48 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:49.122730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'flavor' on Instance uuid 67941698-f5a1-496f-a571-64116228b0d3 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:50:49.688951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2903913b-5979-4e5a-abbb-4a3c33363a36 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/action" status: 202 len: 0 microversion: 2.20 time: 0.603965 Aug 24 03:50:49.689634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 167/312] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 03:50:49 2022] POST /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:50:49.698116 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:49.699153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:49.709288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.710027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.711079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.712259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:49.713050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:49.713954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:49.870347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-155781128", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "networks": [{"uuid": "f202f115-124c-4bc3-ae49-ec5d020c7956"}]}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:49.877006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.885851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.887622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:49.888786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-983faff3-5f4f-492d-9e2b-fe67974e15be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.194685 Aug 24 03:50:49.889495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 146/313] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:49 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:49.930409 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] validate_networks() for [('f202f115-124c-4bc3-ae49-ec5d020c7956', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:50:50.127237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:50.128812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:50.137834 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.139071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.139933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.141296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.142311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.142957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.376975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:50.385829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-01f5ed7b-e731-4bc7-9484-1988f7c83a0a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.263168 Aug 24 03:50:50.386453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 147/314] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:50 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:50.392346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:50:50.392836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:50:50.393246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:50:50.394214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:50:50.394626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:50:50.403830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.404314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.404749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.405472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.405942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.406423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.437378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Getting quotas for project 3cf3b9526fc541048f921613ded8ef2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:50:50.442233 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Getting quotas for user ae04cdfc35964cf58502cefd1cc912e9 and project 3cf3b9526fc541048f921613ded8ef2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:50:50.456701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:50:50.459727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:50:50.577952 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-61d3619f-1a33-4a7c-a0bd-ddb459b3cf0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713567 Aug 24 03:50:50.578897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 168/315] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:50:50.591197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-19cb844c-cbca-448a-bdf8-dea80f1f9b45 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:50.591898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-19cb844c-cbca-448a-bdf8-dea80f1f9b45 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:50.665530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-19cb844c-cbca-448a-bdf8-dea80f1f9b45 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:50.673708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-19cb844c-cbca-448a-bdf8-dea80f1f9b45 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1213 microversion: 2.1 time: 0.086572 Aug 24 03:50:50.674184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 148/316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:50 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:50.913394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:50.914016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:50.920635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.921124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.921567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:50.922318 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:50.922777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:50.923207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:51.060283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:51.068653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:51.070205 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:51.071386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-092ad653-f6e1-4922-8912-f83cfb8f0c62 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.162270 Aug 24 03:50:51.071946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 169/317] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:50 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:50:51.409079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:51.409765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:51.412195 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=52 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:51.417820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:51.418338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:51.418785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:51.419490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:51.419945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:51.420433 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:51.562855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:51.572811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6ceab705-64d2-473c-bae7-1232c75070cf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.167920 Aug 24 03:50:51.573385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 149/318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:51 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:51.696609 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c14fbed1-e01e-4fbf-aaf8-4e065c4b9a20 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:51.697689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c14fbed1-e01e-4fbf-aaf8-4e065c4b9a20 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:51.758453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c14fbed1-e01e-4fbf-aaf8-4e065c4b9a20 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:51.765950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c14fbed1-e01e-4fbf-aaf8-4e065c4b9a20 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1213 microversion: 2.1 time: 0.074671 Aug 24 03:50:51.766687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 170/319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:51 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:52.094319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.094930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:52.101439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.102009 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.102488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.103187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.103639 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.106043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.252342 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.263460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.265064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.266281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5a3f8188-9e33-46f2-8c69-4fa76c3e8664 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.175920 Aug 24 03:50:52.266844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 150/320] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:52.595055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.595791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:52.602228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.602727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.603374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.604083 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.604579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.605069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.758635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.767683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9825a7cb-4ed5-4876-9980-f55b2ae0070a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.176924 Aug 24 03:50:52.770193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 171/321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:52.787575 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:52.788272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:52.794851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.795331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.795761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.796454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:52.796901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:52.797331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:52.865212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:52.880167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a9c6f206-7a30-4cd4-a7c4-ff33878f2f88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1209 microversion: 2.1 time: 0.097276 Aug 24 03:50:52.880778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 151/322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:52 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:53.289911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.290554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.292527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:53.297498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.297988 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.298465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.299173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.300159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.300595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.451367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:53.461546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:53.463304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:53.464296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-659731d4-8f8b-4209-be5d-0225f6b0f961 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.178306 Aug 24 03:50:53.464871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 172/323] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:50:53.790503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.791058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.797709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.798227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.798672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.799476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.800204 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.800637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.912867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:53.913505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.920252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.921216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.921886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.922726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.923426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.923928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.953586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:53.962895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7efd4eae-2210-4e48-a17f-f444cf7a965a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1502 microversion: 2.1 time: 0.176684 Aug 24 03:50:53.963468 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 152/324] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:53.984721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5162d0a-ccd9-423c-8fef-a5f362bda548"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:53.987603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:53.994073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.994602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.995044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:53.995177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:53.995753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:53.996237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:53.996665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.005974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5907814c-db1b-4eda-bbf9-21aa15fd9d2b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1265 microversion: 2.1 time: 0.097922 Aug 24 03:50:54.014961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 173/325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:53 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:54.020959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] HTTP exception thrown: Cannot 'attach_volume' instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac while it is in vm_state rescued Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Request method failure captured: Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/os-volume_attachments HTTP/1.1 Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 74 Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NBKNOnFAmhnImen3ftkidIYzhnWWS3R5xmbQpe7uE64h86W3lRVv8AC6uNhe9l9Tykcb76ZAMkfSQYBC3RL9PI2DSc5plFFVwccoxR1K0uo4yrMy9mCrpwU4Fdz0hHYu20gZojP9A4Cw_CM1aF0PpU4z70GRwr4kWgZVBJyn_xHc Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:50:54.023328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 0772f8b4306f4e239f075f7b1c13790f Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {"volumeAttachment": {"volumeId": "c5162d0a-ccd9-423c-8fef-a5f362bda548"}} Aug 24 03:50:54.024832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Cannot 'attach_volume' instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac while it is in vm_state rescued Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'server_id': '7c98ae52-9a1c-49c4-bd7a-84247b52a2ac', 'body': {'volumeAttachment': {'volumeId': 'c5162d0a-ccd9-423c-8fef-a5f362bda548'}}} Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:50:54.025598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac while it is in vm_state rescued Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:50:54.026914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac while it is in vm_state rescued Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Returning 409 to user: Cannot 'attach_volume' instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac while it is in vm_state rescued {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c3431cc5-5f7a-4f48-adb0-f4946dc4c070 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044286 Aug 24 03:50:54.028270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 153/326] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:50:53 2022] POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 03:50:54.036450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:50:54.036991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:54.043571 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.043992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.044552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.045141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.045594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.046020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.094835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:54.280905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-713e462a-767a-4b54-a7af-800ebcda44a2 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/action" status: 202 len: 0 microversion: 2.1 time: 0.249818 Aug 24 03:50:54.282467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 174/327] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:50:54 2022] POST /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:50:54.290206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.290831 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:54.296880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.297357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.297794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.298509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.298959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.299410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.446441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.456276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-32dd25d9-e24a-479e-ad87-59eddac36cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.169188 Aug 24 03:50:54.457300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 154/328] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:54 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:54.489277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:54.489982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:54.496898 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.497386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.497823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.498643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:54.499102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:54.499522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:54.645787 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.654244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.655809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:54.657003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b6602a5f-e8a5-42ed-b56e-198c86ca2173 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.172624 Aug 24 03:50:54.657548 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 175/329] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:54 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:55.031345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:55.032021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:55.038567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.039102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.039538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.040229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.040678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.041098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.104327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.112495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aa63d802-f2da-41c9-a097-8d6ac9132e2e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1273 microversion: 2.1 time: 0.084582 Aug 24 03:50:55.113065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 155/330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:55 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:55.477335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:55.477941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:55.484022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.484506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.484942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.485628 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.486084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.486536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.620610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.628860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6716e1ef-acdd-4440-b810-d92b555a4baf tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.154834 Aug 24 03:50:55.629427 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 176/331] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:55 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:55.682242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:55.682760 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:55.688679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.689154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.689585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.690521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:55.691110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:55.691531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:55.834613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.849056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.850652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:55.851824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5d8c5459-bd9f-45a3-950a-b670f1d4a9ad tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.173594 Aug 24 03:50:55.852388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 156/332] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:55 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:56.133631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:56.134268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:56.140443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.140931 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.141550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.142288 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.142746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.143365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.212806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:56.221052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-691909a2-8959-44c7-ab88-2d285e8ad85c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1273 microversion: 2.1 time: 0.091214 Aug 24 03:50:56.222371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 177/333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:56 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:56.649867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:56.650520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:56.662363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.663272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.663961 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.665058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.665770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.666585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.673465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:56.819281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:56.827050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b9c1f548-4f09-440f-b304-b292bc637742 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.181123 Aug 24 03:50:56.827615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 157/334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:56 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:56.875605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:56.876217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:56.882911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.883394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.883838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:56.884529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:56.884987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:56.885413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.021544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.029677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.031217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.032374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cd51a90b-1bcc-4e6e-99fa-412e2f7b1c8b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.160850 Aug 24 03:50:57.032919 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 178/335] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:56 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:50:57.243860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:57.244392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:57.250781 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.250939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.251364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.252049 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.252854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.252931 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.332497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:57.340492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d2ad9df3-4c08-4914-b231-0fea9e84aada tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1273 microversion: 2.1 time: 0.100569 Aug 24 03:50:57.341125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 158/336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:57 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:57.851899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:57.852519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:57.858781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.859087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.859480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:57.860265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:57.860640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:57.861069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.007069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.021999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4fa2ae54-fd19-4c51-a281-6137389aee42 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.174149 Aug 24 03:50:58.023207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 179/337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:57 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:50:58.055904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:58.056548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:58.064208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.065286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.065687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.066444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.066903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.067331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.206221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.215265 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.216812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.218043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e8487674-db44-4977-b0a3-3afa3be4e823 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.166486 Aug 24 03:50:58.218650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 159/338] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:58 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:58.371093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:58.371713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:58.378487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.378978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.379418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.380161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:58.380599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:58.381057 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:58.445805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:58.453744 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-31497cc5-3da0-48f2-99df-e482c72f8ca0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1273 microversion: 2.1 time: 0.087729 Aug 24 03:50:58.454345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 180/339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:58 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:59.048225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:59.048941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:59.056248 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.057153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.057291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.058061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.061512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.061512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.202641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.210878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-33c1a0bb-8c1c-4f9f-a8c1-b7eb788d9c67 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.166634 Aug 24 03:50:59.216360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 160/340] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:59 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:50:59.242258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:59.242798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:59.249176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.249678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.250125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.250873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.251373 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.251792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.386692 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.396940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.398308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.399485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-83e6525e-9cf3-4e1f-86cb-b6ddf19c7703 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.161541 Aug 24 03:50:59.401378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 181/341] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:50:59 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:50:59.477117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:50:59.477732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:50:59.483761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.484245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.484702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.485382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:50:59.485837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:50:59.486297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:50:59.555813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:50:59.563643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-21218f20-ffc9-47e4-a006-dc6de696c25d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1283 microversion: 2.1 time: 0.090416 Aug 24 03:50:59.564237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 161/342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:50:59 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:00.232423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.232972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.240391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.240880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.241315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.242011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.242485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.243020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.377145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.384889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7ad8413f-173b-4c3e-9836-eaa39f6390df tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.156417 Aug 24 03:51:00.385445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 182/343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:00 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:00.425016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.425834 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.432514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.433026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.433502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.434205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.434658 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.435081 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.580180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.586338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:00.586952 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:00.588868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:00.589355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.590969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.593522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d1eaacd8-0b29-4a27-ae70-5f8f220d0a2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.172631 Aug 24 03:51:00.593703 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.594279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.594939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 162/344] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:00 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:00.595097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.595525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:00.596408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:00.596893 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:00.674596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:00.682320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-479fd78b-1b98-4480-8d50-414d430a7585 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1283 microversion: 2.1 time: 0.099788 Aug 24 03:51:00.682909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 183/345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:00 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1283 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:01.405906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:01.406660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.408682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:01.414327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.414327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.415076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.415432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.415891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.416319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.559349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.577641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-733af749-d7bb-4a83-b822-3ce5e3c83a20 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.166531 Aug 24 03:51:01.577641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 163/346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:01 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:01.634494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:01.635008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.641102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.641587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.642027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.642862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.643530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.643994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.703268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:01.704216 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:01.711341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.711842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.712275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.712980 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:01.713417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:01.713847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:01.762679 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=8 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:01.794323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.802959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-254233e0-a623-42b2-9e50-063e7dbd0de9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1283 microversion: 2.1 time: 0.103681 Aug 24 03:51:01.803548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 164/347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:01 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:01.806768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.815210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.816844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:01.818041 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9b96d4b7-0933-4f70-b7c7-f9c7fd7c61db tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.187606 Aug 24 03:51:01.818632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 184/348] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:01 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:02.589316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.590033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.598276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.598766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.599283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.599881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.600338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.600745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.747604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:02.756297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-31035450-08cd-4bf5-a70f-ffca4a03c9db tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.171079 Aug 24 03:51:02.756871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 165/349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:02.824674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.825291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.831413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.842865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.842865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.842865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.842865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.843208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.843291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:02.843291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:02.848320 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.848806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.849250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.849944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:02.850428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:02.850858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:02.900897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:02.912221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7e7687ad-3079-4580-ba4e-aba9ae56eb58 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1283 microversion: 2.1 time: 0.091435 Aug 24 03:51:02.913138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 185/350] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:03.013205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.022558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.024081 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.025241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-86c14fad-aacf-4452-8a97-86733056847d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.187834 Aug 24 03:51:03.025795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 166/351] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:02 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:03.781414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.782053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.788669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.790084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.790084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.790413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.790838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.791266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.934515 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:03.941415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:03.941855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:03.948466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-84feb0b7-abe2-4dc0-8956-1189bf908614 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.168708 Aug 24 03:51:03.951332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.961136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.961136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.961136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:03.961136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:03.961594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:03.962855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 186/352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:03 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:04.024905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.033333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fd8cbfe1-a651-4fe0-b64a-6534687655ca tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1271 microversion: 2.1 time: 0.097561 Aug 24 03:51:04.036394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 167/353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:03 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:04.048441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:04.049770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:04.056209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.056860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.057337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.058122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.058606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.059044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.220738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.230745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.232619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:04.233831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2ccee04c-b2b3-49c3-b54f-2f0929d0f9c1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.189453 Aug 24 03:51:04.234391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 187/354] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:04 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:04.969603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:04.970534 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:04.978676 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.979252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.979694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:04.980602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:04.981053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:04.981482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.056641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:05.058001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:05.064102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.069238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.069238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.069238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.069238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.069644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.188008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.196864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7f80ba83-638a-4d89-afac-4cf5dd1d81d9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.231405 Aug 24 03:51:05.197455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 168/355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:04 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:05.251300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.256971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:05.257627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:05.260030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9d0e78fc-542a-4001-90fb-d3dd4c14f2f2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.207520 Aug 24 03:51:05.260612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 188/356] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:05 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:05.263900 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.264401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.264840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.265544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.265994 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.266432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.450681 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.451615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.453454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:05.454822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-daa92e45-fb29-4323-86ca-f1a6d3ff2913 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.201824 Aug 24 03:51:05.456153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 169/357] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:05 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:05.599180 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-fd9e39e2-12f8-44aa-b2c7-3a15b6262281 req-cfb5f7c8-dbf5-4290-9674-b75a8ed0605f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2100ffca-f342-4973-862e-13a5ef53437f", "tag": "a633272a-5ef5-4230-8d4a-aea2aebd7987"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:05.608913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-fd9e39e2-12f8-44aa-b2c7-3a15b6262281 req-cfb5f7c8-dbf5-4290-9674-b75a8ed0605f service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:05.609487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-fd9e39e2-12f8-44aa-b2c7-3a15b6262281 req-cfb5f7c8-dbf5-4290-9674-b75a8ed0605f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:05.610051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-fd9e39e2-12f8-44aa-b2c7-3a15b6262281 req-cfb5f7c8-dbf5-4290-9674-b75a8ed0605f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:05.622242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-fd9e39e2-12f8-44aa-b2c7-3a15b6262281 req-cfb5f7c8-dbf5-4290-9674-b75a8ed0605f service nova] Creating event network-changed:a633272a-5ef5-4230-8d4a-aea2aebd7987 for instance 2100ffca-f342-4973-862e-13a5ef53437f on hv-cinder-85425 Aug 24 03:51:05.627748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-fd9e39e2-12f8-44aa-b2c7-3a15b6262281 req-cfb5f7c8-dbf5-4290-9674-b75a8ed0605f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031906 Aug 24 03:51:05.628557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 189/358] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:05.956438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2a083dc0-7aba-425b-b14a-ab662563e83e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: .version_select at 0x7f6c18212790>, body: {"keypair": {"name": "tempest-keypair-167520712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISNyLY4zRVqRfckjNfiIzNhYA03RZUJBefRaGfnC6ri1c9lxKEgvgF5CUj2KxZdp6jlEa6qrRTw1xlirL9oVAZKUBnvA3FTokqgqbYbroipY544UTqVzpNfvFjDaq47DA=="}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:05.977773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-2a083dc0-7aba-425b-b14a-ab662563e83e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:05.981763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-2a083dc0-7aba-425b-b14a-ab662563e83e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:06.092908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2a083dc0-7aba-425b-b14a-ab662563e83e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140728 Aug 24 03:51:06.093527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 170/359] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:06.220357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.221727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:06.228171 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.232635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.232635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.232635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.232635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.233033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.282935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.284298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:06.291231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.291919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.292548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.295586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.302252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.303110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.459717 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.468568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3fb99179-3a89-4d24-9411-519aa9a4f146 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.252690 Aug 24 03:51:06.473504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 190/360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:06.483353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:06.484082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:06.490959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.491681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.492155 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.492838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:06.493294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:06.493722 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:06.511722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.530255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-77cb4469-30e3-4e43-b3cf-45024a9358ee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.242654 Aug 24 03:51:06.530255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 171/361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:06.639454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.644938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:06.653070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.655792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:06.658031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9020df8-d72c-4b28-94c8-a21409b320d3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.182202 Aug 24 03:51:06.658983 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 191/362] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:06 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:07.492175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:07.493695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:07.502983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.506236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.506236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.506236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.506236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.506705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.543309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:07.543956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:07.552353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.559211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.559211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.559211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.559211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.559575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.704552 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:07.713445 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8fbeb272-3a5e-4bbd-a1be-8c2562f833e8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1510 microversion: 2.1 time: 0.225044 Aug 24 03:51:07.714593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 172/363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:07 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:07.719887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:07.725831 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:07.730884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.732198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.732650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.733371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:07.734039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:07.734564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:07.773698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:07.782420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-aee95e2d-42cb-4ac9-9905-0c5d622dd279 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.243117 Aug 24 03:51:07.797134 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 192/364] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:07 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:08.188740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.199702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.201906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.203146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-43deca0c-4a7e-4d50-b149-f973eef2fa41 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.487272 Aug 24 03:51:08.210372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 173/365] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:07 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:08.735625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.738419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.743442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.743932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.744372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.745095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.745567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.745995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.765944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.766817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.774759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.775252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.775687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.776513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.777158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.777626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.811276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8d0ef417-be72-4a1b-ac5d-98ce2693644b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/ips" status: 200 len: 146 microversion: 2.1 time: 0.049123 Aug 24 03:51:08.819145 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 174/366] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:08.825255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:08.825883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:08.832737 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.833235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.833680 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.834859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:08.835324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:08.835754 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:08.840939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:08.972663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:08.996227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ba5f47f7-216a-480a-a94f-9af4c3f14c30 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1516 microversion: 2.1 time: 0.264630 Aug 24 03:51:08.998728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 193/367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:09.021870 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1677266479", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7017dfb2-6dc7-4b44-a632-2d85a8be9995"}], "security_groups": [{"name": "tempest-securitygroup--1557333167"}], "key_name": "tempest-keypair-167520712", "user_data": "}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:09.100989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.110084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a3b56b2f-a548-4a6d-b524-c95ca9652c60 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.288491 Aug 24 03:51:09.110900 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 175/368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:08 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:09.231374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:09.231374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:09.235028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.235514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.236105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.237551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:09.237921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:09.238378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:09.273142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] validate_networks() for [('7017dfb2-6dc7-4b44-a632-2d85a8be9995', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:09.659089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.676250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.678698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:09.680399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ab5135e3-b713-4883-bff4-b4fb9def01cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.456312 Aug 24 03:51:09.691137 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 176/369] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:09 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:10.132861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.142260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.153219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.153717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.154181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.155085 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.155544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.155967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.288330 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:10.289676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:10.290044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:10.290589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:10.291561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:10.304234 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.304715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.305789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.306561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.307405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.313904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.328265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:10.332788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:10.333286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.341017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f61d6391-a703-4bd1-bd04-7e4ff21d3a78 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.212715 Aug 24 03:51:10.341590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 177/370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:10.344675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:10.347151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:10.589591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7805fdeb-b6bd-431c-b1c7-345688b42a84 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.589031 Aug 24 03:51:10.595886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 194/371] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:10.635438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a1405316-cc30-461b-87bc-c4f6421b320d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.635438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a1405316-cc30-461b-87bc-c4f6421b320d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.706956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:10.707976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:10.714847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.715417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.715931 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.716717 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:10.717250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:10.717837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:10.734575 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a1405316-cc30-461b-87bc-c4f6421b320d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.746117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a1405316-cc30-461b-87bc-c4f6421b320d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1241 microversion: 2.1 time: 0.136115 Aug 24 03:51:10.747673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 178/372] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:10.878378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.886569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.888074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:10.889218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-68cd04d8-33ac-4549-8d72-fba5de9673ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.187185 Aug 24 03:51:10.889852 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 195/373] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:10 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:11.377617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.378399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:11.387563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.388527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.389298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.390644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.391787 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.393227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.582135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:11.593739 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-eceebe05-8d77-4a54-bada-72df9fa10fec tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.222637 Aug 24 03:51:11.602899 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 179/374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:11.769751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.770404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:11.776413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.780954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.781439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.782185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.782716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.783267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.853302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:11.862748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-08c5cce0-5679-43c9-8a4a-229a0fd0fd4c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1245 microversion: 2.1 time: 0.097320 Aug 24 03:51:11.870078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 196/375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:11.912811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:11.913422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:11.920092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.920594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.921032 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:11.921731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:11.922202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:11.922636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.068514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.076830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.078376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.079533 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a92467d9-daed-40a2-bfec-530fd82eb04b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.170660 Aug 24 03:51:12.080612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 180/376] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:11 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:12.334634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-239e05c3-864d-4e9a-bb5a-2ea3ec1972de tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'create', calling method: .version_select at 0x7f6c180bf700>, body: {"keypair": {"name": "tempest-keypair-1564381336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJ5PM7Tv3FD/61E0wcVkFinOcEu+i8TQjPTkhT5V3/mlomaKi3SzLth8H/q4W1ZF3FSlX6yFpAq20SWFiVMZSjEDPe3d6fPmxDE74rv/mspF5aDUVPcxfoKhcXQyYTOjA=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:12.351464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-239e05c3-864d-4e9a-bb5a-2ea3ec1972de tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for project c993aed86aaf431495a2d1724218fa9b. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:12.355501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-239e05c3-864d-4e9a-bb5a-2ea3ec1972de tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for user 0772f8b4306f4e239f075f7b1c13790f and project c993aed86aaf431495a2d1724218fa9b. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:12.462405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-239e05c3-864d-4e9a-bb5a-2ea3ec1972de tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132325 Aug 24 03:51:12.463218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 197/377] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:12.623228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.623228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:12.630889 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.631475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.632165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.632959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.633676 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.634337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.784585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.792460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e769e9ec-987a-4d97-9e81-e2eb81a23099 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.179839 Aug 24 03:51:12.793028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 181/378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:12.891543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:12.891543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:12.899210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.899653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.900189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.901139 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:12.901810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:12.902476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:12.991103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:12.999957 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3cc618c5-3a64-4dff-b086-3d7cf7c1f03e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1237 microversion: 2.1 time: 0.115049 Aug 24 03:51:13.003804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 198/379] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:12 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:13.102562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:13.103283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:13.109478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.109972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.110437 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.120779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.120779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.120779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.263765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.272751 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.274489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.275645 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-36601451-3106-462f-b40f-52a27ce1abdc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.177292 Aug 24 03:51:13.276207 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 182/380] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:13.489021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4edfbfd2-50c5-475a-aad3-cd61211cb09a"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:13.491462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:13.497457 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.498021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.498555 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.499252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.499704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.500127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.813373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:13.813988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:13.820722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.821270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.821710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.822605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:13.823059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:13.823484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:13.955670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:13.963455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2a2bd34b-d549-4324-b462-ae456b055ebb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.153767 Aug 24 03:51:13.964228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 183/381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:13 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:14.024807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.025426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.031353 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.031872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.032335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.033265 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.033713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.034133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.099428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.107063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d947cdce-f9d8-4db5-a1a3-467983af24d2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1237 microversion: 2.1 time: 0.086045 Aug 24 03:51:14.107624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 184/382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:14.299956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.300676 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.306792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.307277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.320692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.320692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.320692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.320692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.442100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.452992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.456082 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:14.457351 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7ecf718d-39fe-47fc-a539-a170cf7aede0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.162676 Aug 24 03:51:14.458134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 185/383] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:14.985301 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:14.986732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:14.993898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.994340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.994779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:14.995525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:14.995932 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:14.996355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.132747 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.140323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-56b41dff-3fe9-494a-846c-e8502d3c064e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.158927 Aug 24 03:51:15.140886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 186/384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:14 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:15.146350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1890070790", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36cb3bc8-9b57-4e0a-ae7e-6971cdae89f2"}], "security_groups": [{"name": "tempest-securitygroup--1037953077"}], "key_name": "tempest-keypair-1564381336", "user_data": "}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:15.257908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] validate_networks() for [('36cb3bc8-9b57-4e0a-ae7e-6971cdae89f2', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:15.649531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:15.649956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:15.650452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:15.650880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:15.651283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:15.660238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.660716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.661151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.661863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.662339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.662762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.679985 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for project c993aed86aaf431495a2d1724218fa9b. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:15.684027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Getting quotas for user 0772f8b4306f4e239f075f7b1c13790f and project c993aed86aaf431495a2d1724218fa9b. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:15.693604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:15.696254 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:15.698666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:15.825663 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4e8c743d-9103-4396-b0eb-1b6b67ed9ab6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.683756 Aug 24 03:51:15.832267 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 187/385] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:15.832267 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:15.832526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:15.838733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.839292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.839645 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.842332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.842332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.842332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.907112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:15.915476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b513bafb-f4ff-4f21-9879-b52b6a2b3f6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1237 microversion: 2.1 time: 0.087589 Aug 24 03:51:15.916056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 188/386] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:15 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:15.920921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:15.921717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:15.927963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.928597 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.929888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:15.930941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:15.931398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:15.931826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.068059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.076484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.077989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.079285 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f75ce299-f538-4ce6-b25a-3ec8355a1d67 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.162311 Aug 24 03:51:16.080564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 189/387] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:15 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:16.085002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d10259b5-f58f-435d-9d62-07700c0295ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.085679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d10259b5-f58f-435d-9d62-07700c0295ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:16.142614 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d10259b5-f58f-435d-9d62-07700c0295ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.149604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d10259b5-f58f-435d-9d62-07700c0295ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1246 microversion: 2.1 time: 0.068050 Aug 24 03:51:16.150202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 190/388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:16.161101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.161800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:16.167942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.169863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.169863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.169863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.170146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.170413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.311461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:16.319596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-96b9e3a4-e235-448d-bbd4-b5c5afd70190 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.162727 Aug 24 03:51:16.320099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 191/389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:16.939568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:16.940233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:16.946692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.947182 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.947644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:16.948694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:16.949320 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:16.949756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.017671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.025646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-08414973-7cf8-47d4-8b31-b9f09c33f3b6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1237 microversion: 2.1 time: 0.090771 Aug 24 03:51:17.026231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 192/390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:16 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:17.103845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.104567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.110501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.111697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.111862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.112511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.112964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.113386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.266029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.275715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.277272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.278688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f3a717fe-7c5d-4eec-884f-6a463d5728ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.178867 Aug 24 03:51:17.279255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 193/391] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:17 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:17.290053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.290924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.297412 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.297899 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.298407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.299153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.299607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.300031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.319227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:17.368463 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.376588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-70646da7-0923-495f-8480-90908166c37f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1250 microversion: 2.1 time: 0.090146 Aug 24 03:51:17.377161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 194/392] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:17 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:17.381577 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:17.382241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:17.388881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.389369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.389808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.390619 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:17.391080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:17.391507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:17.550654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:17.553734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-355198ea-74e1-44e4-9f8c-d37f150d6155 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.175460 Aug 24 03:51:17.554341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 195/393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:17 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:18.038946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f3c8dcfc-132f-4ca0-8fb1-2334236097e7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.554455 Aug 24 03:51:18.046371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 199/394] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:51:13 2022] POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-volume_attachments => generated 194 bytes in 4557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:18.050950 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.051570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.058720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.059400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.059844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.060609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.061173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.061596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.136129 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.144773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a95a9374-28c1-485d-b953-ce9401036057 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1237 microversion: 2.1 time: 0.101022 Aug 24 03:51:18.145607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 196/395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:18.303922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.304631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.311660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.312154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.312593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.313301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.313856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.314316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.397298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.398245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.405370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.405539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.412485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.413860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.414442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.414885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.505490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.509914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.520103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bbccbecb-e748-487f-b856-ea9c549411ce tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1242 microversion: 2.1 time: 0.126553 Aug 24 03:51:18.520228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.521325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 197/396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:18.523524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.528088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a2baa3ac-f049-4a26-a60b-b0a1ea359d7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1742 microversion: 2.20 time: 0.228701 Aug 24 03:51:18.528702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 200/397] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1742 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:18.577381 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:18.578046 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:18.584975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.585469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.586124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.586674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:18.587845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:18.588274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:18.735688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:18.743858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-46c101fd-6da7-4341-9148-528e28e464c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.172314 Aug 24 03:51:18.744430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 198/398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:18 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:19.165782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:19.166429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:19.172365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.174998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.174998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.174998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.174998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.175464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.238649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.246308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ac69e6d7-dd0c-4a80-9b16-afc8fc245db0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1293 microversion: 2.1 time: 0.084290 Aug 24 03:51:19.246872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 201/399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:19 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:19.542390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:19.543015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:19.550095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.550881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.551130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.552465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.553226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.553726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.556797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:19.557406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:19.563592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.567340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.567340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.567340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.567340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.567675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.623198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.630886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-435a9047-3341-42bc-b657-7f0e6979e597 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1242 microversion: 2.1 time: 0.092380 Aug 24 03:51:19.631459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 199/400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:19 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:19.722507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.730748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.732258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.736933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d2d25072-0246-4f71-a19d-ba9c1ca4c48b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1742 microversion: 2.20 time: 0.181503 Aug 24 03:51:19.736933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 202/401] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:19 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:19.764430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:19.765037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:19.772198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.772507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.776917 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.776917 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:19.776917 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:19.776917 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:19.905733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:19.913525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7edcba68-6682-41c1-9e95-f12d1b04a7a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.153079 Aug 24 03:51:19.914092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 200/402] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:19 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:20.269079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.269690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.276012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.276495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.276935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.277629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.278086 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.278543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.318534 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:20.342477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.350876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0fadde98-2d76-46e4-a4a7-d251c393221a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1301 microversion: 2.1 time: 0.086148 Aug 24 03:51:20.351440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 203/403] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:20.651611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.652250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.659116 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.659601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.660037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.660799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.661253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.661677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.722823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.730298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6ca1165f-3749-48ae-9279-629beb6e2d98 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1298 microversion: 2.1 time: 0.082487 Aug 24 03:51:20.730854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 201/404] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:20.759441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.760087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.766681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.767731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.768172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.768866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.769323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.769751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.903104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.911418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.912976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:20.914133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4d67dc64-6b46-420c-9cd4-b1634d8bb794 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1742 microversion: 2.20 time: 0.160719 Aug 24 03:51:20.914712 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 204/405] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:20.934493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:20.935127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:20.941791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.942290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.942758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:20.943446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:20.943897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:20.944323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.072588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.080916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-af09ed67-0893-4233-9605-e590fa733d69 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.150233 Aug 24 03:51:21.081469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 202/406] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:20 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.372381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.373046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.379492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.380015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.380500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.381179 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.381626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.382047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.446366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.453934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2004d63e-a29f-49de-880e-6d25bc6cd313 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1301 microversion: 2.1 time: 0.085422 Aug 24 03:51:21.454916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 205/407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.752062 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.752680 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.759747 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.760233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.760670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.761446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.761894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.762348 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.828664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:21.837353 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d0ebe9af-63d3-456e-ae3c-5cfcd1045850 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1298 microversion: 2.1 time: 0.089504 Aug 24 03:51:21.837941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 203/408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:21.937278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:21.937917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:21.945393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.945879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.949071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:21.949071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:21.949071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:21.949071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.085950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.094639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.096369 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.097423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b6bff35e-0870-401f-af21-f4a5822f0abe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1742 microversion: 2.20 time: 0.164279 Aug 24 03:51:22.097978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 206/409] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:21 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:22.101423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:22.102041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:22.108523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.109010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.109447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.110144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.110630 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.111372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.244890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.253684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f3746c18-656a-4765-ac51-e4386ee3b20e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.155865 Aug 24 03:51:22.254144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 204/410] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:22 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:22.474579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:22.475196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:22.477048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=10 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:22.481791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.482320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.482768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.483462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.483922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.484383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.545871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.554260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c63b031f-d714-4d48-bb4c-9174a25bd846 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1301 microversion: 2.1 time: 0.083539 Aug 24 03:51:22.554825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 207/411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:22 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:22.859542 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:22.860270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:22.867644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.868169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.868611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.869361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:22.869766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:22.870220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:22.935165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:22.943893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f7749482-7dcf-46a5-9a0e-566c2e1b66fe tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1298 microversion: 2.1 time: 0.088374 Aug 24 03:51:22.948316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 205/412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:22 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:23.124729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.125984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.137438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.138337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.139120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.140362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.141122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.141547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.274622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.275236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.281468 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.281956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.282422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.283131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.283580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.284000 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.379459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.390764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:23.394744 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.397161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.399414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-97a42b26-a7b4-45ce-970d-3e0428b831c4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1742 microversion: 2.20 time: 0.282265 Aug 24 03:51:23.400184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 208/413] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1742 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:23.440760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-f83d723f-9f8d-49f5-a07e-fb6122cd9668 req-d77fa978-dc8f-4895-8372-4bfca5c85c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2100ffca-f342-4973-862e-13a5ef53437f", "name": "network-vif-plugged", "status": "completed", "tag": "a633272a-5ef5-4230-8d4a-aea2aebd7987"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:23.447514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:23.451770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-f83d723f-9f8d-49f5-a07e-fb6122cd9668 req-d77fa978-dc8f-4895-8372-4bfca5c85c09 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.452513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-f83d723f-9f8d-49f5-a07e-fb6122cd9668 req-d77fa978-dc8f-4895-8372-4bfca5c85c09 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.453201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-f83d723f-9f8d-49f5-a07e-fb6122cd9668 req-d77fa978-dc8f-4895-8372-4bfca5c85c09 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.463520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.466817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-f83d723f-9f8d-49f5-a07e-fb6122cd9668 req-d77fa978-dc8f-4895-8372-4bfca5c85c09 service nova] Creating event network-vif-plugged:a633272a-5ef5-4230-8d4a-aea2aebd7987 for instance 2100ffca-f342-4973-862e-13a5ef53437f on hv-cinder-85425 Aug 24 03:51:23.471912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d5b0c945-2484-4734-a4ee-e3f8b24fddfc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.201274 Aug 24 03:51:23.472102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-f83d723f-9f8d-49f5-a07e-fb6122cd9668 req-d77fa978-dc8f-4895-8372-4bfca5c85c09 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037444 Aug 24 03:51:23.472786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 206/414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:23.472915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 209/415] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:51:23.576424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.577035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.591253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.591759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.592199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.592964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.593441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.593893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.662613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:23.670402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1d6baac4-f81d-4961-92ce-9f8fba164c22 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1311 microversion: 2.1 time: 0.098015 Aug 24 03:51:23.670963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 207/416] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:23.967430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:23.968519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:23.976626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.977369 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.986892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:23.986892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:23.986892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:23.986892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.078656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.088126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8606d1b5-9212-4bf5-bda0-9a330145006c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1298 microversion: 2.1 time: 0.125328 Aug 24 03:51:24.088891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 210/417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:23 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:24.447511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.449793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.466023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.467379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.468616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.470486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.471349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.474926 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.496899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.497620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.510878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.511664 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.513023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.513925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.514662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.515288 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.859389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.874464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.877234 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.878805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2aca8fa7-926a-445f-9536-f8a814b22fa4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.452680 Aug 24 03:51:24.895228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 208/418] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:24.895228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:24.895228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:24.900289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.901136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.901581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.902377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:24.902836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:24.903266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:24.906825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.917240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0cb11f98-4248-4605-b9d5-48b25c7a152a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.427020 Aug 24 03:51:24.917791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 211/419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:24.983389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:24.996075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d2a3f16a-06e3-4238-b11d-dce9f53c421c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1299 microversion: 2.1 time: 0.109413 Aug 24 03:51:24.997209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 209/420] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:24 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:25.113408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.115141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.120151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.120873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.121477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.122190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.122796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.123411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.191930 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:25.202776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-757439a8-5b3b-450b-a7dc-4ceda7d6edb9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1316 microversion: 2.1 time: 0.093960 Aug 24 03:51:25.228346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 212/421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1316 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:25.900911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:25.906653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.907868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.915418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.916319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.917015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.918465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.919601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.920250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.944564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:25.945514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:25.952751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.953690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.954985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:25.955965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:25.956718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:25.957580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.147112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=14 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:26.293716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.308126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.309896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.314769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-add29969-8e92-4207-ac81-516b1bb32c4a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.415375 Aug 24 03:51:26.318021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 210/422] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:26.330769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:26.331707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:26.339229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.339675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.340329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.341345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.342458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.342707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.343818 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.350048 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:26.356996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f7caa3ce-827e-4558-b1e8-830216ef18fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.413933 Aug 24 03:51:26.359792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 213/423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:25 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:26.372990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:26.374673 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:26.417845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.418416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.426029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.429732 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:26.432747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:26.433227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:26.620196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.632913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b5989a6b-4db4-4fd1-ba2b-a1284cbbd637 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1304 microversion: 2.1 time: 0.267810 Aug 24 03:51:26.634146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 214/424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:26 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1304 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:26.683868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:26.699718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7b62ee2e-ad49-47de-b72f-f457d053c263 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.380024 Aug 24 03:51:26.700927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 211/425] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:26 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:27.343711 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:27.345947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:27.356919 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.357749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.358466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.359909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.361495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.362396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.387277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:27.389530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:27.413057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.413906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.414591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:27.415596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:27.416303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:27.417334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.006952 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.019481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.034832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.041600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-aa21f334-de55-494b-8d4b-e591b4f9adfb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.704244 Aug 24 03:51:28.042871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 215/426] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:27 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:28.057879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-82b9b118-d04a-4e89-8b05-c73105d3f8f4 req-1e7e8cb6-6e0b-46f8-825c-626ff5adc6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "name": "network-vif-plugged", "status": "completed", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:28.093846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-82b9b118-d04a-4e89-8b05-c73105d3f8f4 req-1e7e8cb6-6e0b-46f8-825c-626ff5adc6a4 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.100408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-82b9b118-d04a-4e89-8b05-c73105d3f8f4 req-1e7e8cb6-6e0b-46f8-825c-626ff5adc6a4 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.104739 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-82b9b118-d04a-4e89-8b05-c73105d3f8f4 req-1e7e8cb6-6e0b-46f8-825c-626ff5adc6a4 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.147982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-82b9b118-d04a-4e89-8b05-c73105d3f8f4 req-1e7e8cb6-6e0b-46f8-825c-626ff5adc6a4 service nova] Creating event network-vif-plugged:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:51:28.158795 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-82b9b118-d04a-4e89-8b05-c73105d3f8f4 req-1e7e8cb6-6e0b-46f8-825c-626ff5adc6a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110966 Aug 24 03:51:28.158795 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 216/427] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:28.168350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.169034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.184665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.185827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.186672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.187708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.189344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.190639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.239976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.248635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c27681a7-6823-4e08-9d16-81e2f2daf95d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1313 microversion: 2.1 time: 0.866953 Aug 24 03:51:28.251536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 212/428] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:27 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:28.266204 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:28.268604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:28.286352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.287909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.288682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.289667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.293643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.293643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.597511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.619568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7c850deb-566a-4bad-b44c-bf8185171f89 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.364210 Aug 24 03:51:28.630944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 213/429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:28.654172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:28.663626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5405dfde-fbdb-4a82-9942-06ae4901d8b1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.500126 Aug 24 03:51:28.664735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 217/430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:28 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:28.754643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-89f5aa56-0dc1-45c8-aa90-a36602680f72 req-8c721b21-5ec6-4f68-9532-6efa2ee9a597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928f3671-5aef-464f-8035-cc9ee087a394", "tag": "1a683477-a998-4ddb-8c06-dfa7486b6620"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:28.778922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-89f5aa56-0dc1-45c8-aa90-a36602680f72 req-8c721b21-5ec6-4f68-9532-6efa2ee9a597 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:28.782010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-89f5aa56-0dc1-45c8-aa90-a36602680f72 req-8c721b21-5ec6-4f68-9532-6efa2ee9a597 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:28.784988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-89f5aa56-0dc1-45c8-aa90-a36602680f72 req-8c721b21-5ec6-4f68-9532-6efa2ee9a597 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:28.809638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-89f5aa56-0dc1-45c8-aa90-a36602680f72 req-8c721b21-5ec6-4f68-9532-6efa2ee9a597 service nova] Creating event network-changed:1a683477-a998-4ddb-8c06-dfa7486b6620 for instance 928f3671-5aef-464f-8035-cc9ee087a394 on hv-cinder-85425 Aug 24 03:51:28.824018 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-89f5aa56-0dc1-45c8-aa90-a36602680f72 req-8c721b21-5ec6-4f68-9532-6efa2ee9a597 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073126 Aug 24 03:51:28.826204 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 214/431] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:29.069950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.070714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.085771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.086467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.091135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.092151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.095213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.096182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.279849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.280563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.301490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.307901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.310395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.315191 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.315689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.316154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.585965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.609392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.609392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.609392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d35e7079-2d76-46fa-ac59-cba1a1985676 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.540326 Aug 24 03:51:29.609883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 218/432] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:29.610056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-7ccb6d56-cfdd-41d7-8759-8fabfce38251 req-4b51d04c-c83f-4f1f-9837-b25d2efa773d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611ffff0-163e-4c5f-83be-b31e72dd599c", "tag": "0d9a4992-1d7c-44c3-aefb-900ad718be1f"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:29.620684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7ccb6d56-cfdd-41d7-8759-8fabfce38251 req-4b51d04c-c83f-4f1f-9837-b25d2efa773d service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.621494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7ccb6d56-cfdd-41d7-8759-8fabfce38251 req-4b51d04c-c83f-4f1f-9837-b25d2efa773d service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.622138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7ccb6d56-cfdd-41d7-8759-8fabfce38251 req-4b51d04c-c83f-4f1f-9837-b25d2efa773d service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.636516 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-7ccb6d56-cfdd-41d7-8759-8fabfce38251 req-4b51d04c-c83f-4f1f-9837-b25d2efa773d service nova] Creating event network-changed:0d9a4992-1d7c-44c3-aefb-900ad718be1f for instance 611ffff0-163e-4c5f-83be-b31e72dd599c on hv-cinder-85425 Aug 24 03:51:29.643716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-7ccb6d56-cfdd-41d7-8759-8fabfce38251 req-4b51d04c-c83f-4f1f-9837-b25d2efa773d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037678 Aug 24 03:51:29.644924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 219/433] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:29.651850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.655310 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.661533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.662374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.663055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.663988 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.664654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.665368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.710344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.767350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fd406023-473b-486b-a968-616897499a6f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1497 microversion: 2.1 time: 0.491509 Aug 24 03:51:29.769560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 215/434] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1497 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:29.784229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:29.788485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:29.804740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.808167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.812876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.812876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:29.813988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:29.816358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:29.902124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:29.914172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5c1d8a01-0248-45e0-a4a1-b4b64af9e5d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.267436 Aug 24 03:51:29.915045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 220/435] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:30.133095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.142450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bbc8f9be-5db0-42ff-96d1-77fb8ee503dd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.369764 Aug 24 03:51:30.143325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 216/436] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:29 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:30.631115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:30.631720 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:30.638390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.638868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.639301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.639989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.640439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.640859 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.793772 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.802419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.803945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:30.805114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6a570ab7-1950-449d-9d7a-ad77cf3f4143 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.177880 Aug 24 03:51:30.805668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 221/437] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:30 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:30.945561 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:30.946382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:30.953299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.954000 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.954750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:30.956135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:30.959984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:30.960699 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.167313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:31.168254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:31.179795 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.181654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.182731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.184166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.186036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.188153 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.217425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.233011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e4d1d470-d876-4e6d-a5fa-09ff6ffe2d68 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.292529 Aug 24 03:51:31.238721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 217/438] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:30 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:31.540704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:31.551810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f8563348-ee28-4120-89cc-b849eb9b1ed6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.388774 Aug 24 03:51:31.554289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 222/439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:31 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:31.663229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155b4a58-e6fa-4ba3-8243-68f16efd3d63", "device": "/dev/sdb"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:31.666103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:31.678603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.679416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.680023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.680883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.681491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.682088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.830642 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:31.832915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:31.842116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.842918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.843375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:31.844305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:31.844806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:31.845234 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.024782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.036552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.039484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.043381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0f427bc3-fa66-4d02-b57b-3587c44b70ef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.219029 Aug 24 03:51:32.044060 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 223/440] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:31 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:32.169916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:32.170697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:32.179208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.185272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.185272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.185272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.185272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.185613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.214971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:51:32.568927 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-defb7921-3ab0-4713-aa81-7e9cb69c9cb7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 204 len: 0 microversion: 2.1 time: 0.401665 Aug 24 03:51:32.575621 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 224/441] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:51:32 2022] DELETE /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:32.588204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:32.588960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:32.596493 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.597104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.597421 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.598136 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.598630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.599134 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.807283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:32.819574 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:32.828570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ee2e2ede-d6f6-4765-9201-0bee8abbb5b5 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.257372 Aug 24 03:51:32.829708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 225/442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:32 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:32.838346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:32.844129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:32.865514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.866350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.867024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:32.867893 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:32.868417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:32.868850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.084740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.093037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b7ceda0d-31cb-4724-ac22-f02374d5b8f0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.261220 Aug 24 03:51:33.093850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 226/443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:32 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:33.099741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.100672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.114933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.115775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.116409 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.118291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.118972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.120021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.444756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.472433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cc42c168-2bab-4450-a87d-0a926cd5b373 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1503 microversion: 2.1 time: 0.371132 Aug 24 03:51:33.473163 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 227/444] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:33.494103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.495134 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.510642 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.511426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.512111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.513396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.515026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.515743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.784026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.793496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.795050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:33.796440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4425f3ad-f96f-4f68-9d53-9ba44f7196c8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.322045 Aug 24 03:51:33.798200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 228/445] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:33.865494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:33.868477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:33.877352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.881226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.881226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:33.881226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:33.881226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:33.882066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.149509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:34.158814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3b1f8061-9c35-4d9c-a148-0331cf4b5f94 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.299239 Aug 24 03:51:34.159833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 229/446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:33 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:34.165098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.174333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.180136 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.180370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.180727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.181556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.182096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.182687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.381463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:34.381463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-209480b2-8ef0-48bd-b32d-09c3992e5bb5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.189375 Aug 24 03:51:34.381463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 230/447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:34.496597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.497337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.504094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.504550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.504984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.505674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.506119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.506563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.642691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:34.651174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7cb7d00c-c399-4fab-a8cf-0f01f01934fc tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1503 microversion: 2.1 time: 0.158669 Aug 24 03:51:34.651746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 231/448] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:34.820947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:34.821476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:34.827676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.828163 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.828600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:34.829481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:34.830047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:34.830503 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.156583 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.170471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.176033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.177737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7c8de122-32b9-4bbc-b5a1-61944c815890 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.360790 Aug 24 03:51:35.190841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 232/449] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:34 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:35.201908 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:35.202900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:35.213074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.213848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.214460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.215357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.215968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.216588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.499037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.512211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-34cf130a-e656-4d3b-be06-247d5eaa9173 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.316507 Aug 24 03:51:35.513123 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 233/450] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:35 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:35.522322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:35.523737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:35.541579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.542485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.543664 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.544823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:35.546253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:35.546968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:35.924749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:35.964371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-58f91f19-cc9a-42e1-afb2-9ed8b3281c18 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.438487 Aug 24 03:51:35.971697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 234/451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:35 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:35.994861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:35.998842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.034497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.035895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.036562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.037501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.038261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.039258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.263093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.275604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4abed162-6e2f-460b-a2bd-a7ce1b039eb4 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1503 microversion: 2.1 time: 0.301867 Aug 24 03:51:36.291194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 235/452] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:35 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:36.303358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.304284 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.312068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.312560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.313024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.320201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.320801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.321266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.529601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.541048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.543017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.544448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-150e1ca0-e97b-4793-bfdf-cbb829cb1828 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.255101 Aug 24 03:51:36.545592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 236/453] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:36.554635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.555511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:36.563790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.565424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.566486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.567590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:36.575269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:36.575269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:36.858950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:36.870821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-086fe860-d2ce-4a16-8f2f-f6118dd8907c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.323759 Aug 24 03:51:36.871626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 237/454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:36.995170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:36.998660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:37.019648 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.020543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.021202 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.022348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.023071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.023862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.273715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.285218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3a17894b-1092-4427-a356-cc7ea61b052a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.295778 Aug 24 03:51:37.306668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 238/455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:36 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:37.314087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:37.315198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:37.322711 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.323730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.324530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.326527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.327348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.327998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.590522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.612201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d9754c06-07b5-42ea-a6c5-97ddd2506b50 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1503 microversion: 2.1 time: 0.303945 Aug 24 03:51:37.617472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 239/456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:37 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:37.629248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:37.631846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:37.655863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.655863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.655863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.655863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.658606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.660056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.886520 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.903862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.910232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:37.911562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4062293c-e74a-48ba-8dff-947903d85034 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.292321 Aug 24 03:51:37.917746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 240/457] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:37 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:37.925365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:37.931528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:37.949117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.949782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.950262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:37.951022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:37.951487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:37.951923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.194698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.205014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c713c0eb-c64a-4d3b-ac37-8e82c54ccdc3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.286041 Aug 24 03:51:38.205918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 241/458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:37 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:38.307986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:38.309458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:38.339034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.343166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.345915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.347755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.351126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.351640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.428326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:38.826009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:38.837652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e8ddfcc1-f606-400a-9c05-4c67b400f9ea tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.533473 Aug 24 03:51:38.838533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 242/459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:38 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:38.868996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:38.869658 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:38.888480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.889160 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.889622 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:38.890855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:38.894292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:38.894292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.449543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-da0b8588-963e-44b6-8043-1a1b74a1fd56 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "POST /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.790009 Aug 24 03:51:39.462863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 218/460] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:51:31 2022] POST /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24/os-volume_attachments => generated 194 bytes in 7793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:39.476047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:39.477051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:39.500969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.501538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.502095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:39.502958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:39.503550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:39.504083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.027124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.041985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4eeb1d8a-9702-4d92-acb9-e372e1ae2b80 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1503 microversion: 2.1 time: 1.183125 Aug 24 03:51:40.043098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 243/461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:38 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1503 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:40.058669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:40.059637 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:40.071494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.072311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.072937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.074015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.077567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.079444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.361799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.386687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.390074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.396825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7e80f354-1258-4a34-bd96-213804bbb693 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.928504 Aug 24 03:51:40.416132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 219/462] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:39 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:40.435459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-56e24f3a-1577-4c72-a651-0f8bca7482b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:40.453330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56e24f3a-1577-4c72-a651-0f8bca7482b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.454928 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56e24f3a-1577-4c72-a651-0f8bca7482b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.456690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56e24f3a-1577-4c72-a651-0f8bca7482b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.514176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:40.549207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2d790832-68e9-42a9-89b4-cf1aeebbde10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.504417 Aug 24 03:51:40.558780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 244/463] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:40 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:40.585070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-1028833f-1f23-4763-aa00-372b5fb8d96a req-b03d4e0b-020a-4ac7-b8f0-4733857f5972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611ffff0-163e-4c5f-83be-b31e72dd599c", "name": "network-vif-plugged", "status": "completed", "tag": "0d9a4992-1d7c-44c3-aefb-900ad718be1f"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:40.598358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-56e24f3a-1577-4c72-a651-0f8bca7482b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Going to try to stop instance {{(pid=127736) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:51:40.606309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1028833f-1f23-4763-aa00-372b5fb8d96a req-b03d4e0b-020a-4ac7-b8f0-4733857f5972 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.607498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1028833f-1f23-4763-aa00-372b5fb8d96a req-b03d4e0b-020a-4ac7-b8f0-4733857f5972 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.608153 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1028833f-1f23-4763-aa00-372b5fb8d96a req-b03d4e0b-020a-4ac7-b8f0-4733857f5972 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.645631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-1028833f-1f23-4763-aa00-372b5fb8d96a req-b03d4e0b-020a-4ac7-b8f0-4733857f5972 service nova] Creating event network-vif-plugged:0d9a4992-1d7c-44c3-aefb-900ad718be1f for instance 611ffff0-163e-4c5f-83be-b31e72dd599c on hv-cinder-85425 Aug 24 03:51:40.652342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-1028833f-1f23-4763-aa00-372b5fb8d96a req-b03d4e0b-020a-4ac7-b8f0-4733857f5972 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089097 Aug 24 03:51:40.653885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 245/464] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:40.661037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-c34db8e8-9700-49d6-9b03-befdd99189f1 req-d5a68b09-19cf-4006-b396-5b1a348f3885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2100ffca-f342-4973-862e-13a5ef53437f", "name": "network-vif-deleted", "tag": "a633272a-5ef5-4230-8d4a-aea2aebd7987"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:40.678784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c34db8e8-9700-49d6-9b03-befdd99189f1 req-d5a68b09-19cf-4006-b396-5b1a348f3885 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.679759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c34db8e8-9700-49d6-9b03-befdd99189f1 req-d5a68b09-19cf-4006-b396-5b1a348f3885 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.680422 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c34db8e8-9700-49d6-9b03-befdd99189f1 req-d5a68b09-19cf-4006-b396-5b1a348f3885 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.714432 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-c34db8e8-9700-49d6-9b03-befdd99189f1 req-d5a68b09-19cf-4006-b396-5b1a348f3885 service nova] Creating event network-vif-deleted:a633272a-5ef5-4230-8d4a-aea2aebd7987 for instance 2100ffca-f342-4973-862e-13a5ef53437f on hv-cinder-85425 Aug 24 03:51:40.730755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-c34db8e8-9700-49d6-9b03-befdd99189f1 req-d5a68b09-19cf-4006-b396-5b1a348f3885 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075034 Aug 24 03:51:40.731531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 246/465] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:40.747809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:40.749496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:40.758882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.759916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.762193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.762580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:40.764091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:40.764776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:40.976426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-56e24f3a-1577-4c72-a651-0f8bca7482b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action" status: 202 len: 0 microversion: 2.1 time: 0.568120 Aug 24 03:51:40.977332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 220/466] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:51:40 2022] POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:51:41.009087 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:41.009966 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:41.030205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.032848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.033985 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.051923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.052913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.067166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.084378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.114874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-952aec6e-b633-4c72-8a53-73d0a3e44fb7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.359115 Aug 24 03:51:41.133362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 247/467] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:40 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:41.149900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:41.149900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:41.149900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.149900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.150610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.151582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.153864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.154660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.195368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.196352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.197011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.197568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lazy-loading 'fault' on Instance uuid 2100ffca-f342-4973-862e-13a5ef53437f {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:51:41.306835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.316335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-506e2ac4-a606-44fe-baf2-cb3f189ac035 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 200 len: 1303 microversion: 2.1 time: 0.181397 Aug 24 03:51:41.316729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 248/468] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:41 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 1303 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:41.422464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.425789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:41.426656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:41.432804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-33fddd0e-f38a-4634-bcfa-f6a4f69dad0e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.436746 Aug 24 03:51:41.433804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 221/469] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:40 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:41.441408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.441408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.442914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.443223 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.443849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.444498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.582002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:41.597688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:41.611990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.612500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.613752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.614691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:41.615496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:41.616231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:41.676668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.686352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.688605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.689610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-03eaaedc-8d76-45b8-bf5f-a71803224119 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.270427 Aug 24 03:51:41.690432 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 249/470] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:41 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:41.772579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:41.781033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d6c0d599-722b-4836-9061-261e2b2f7503 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.203737 Aug 24 03:51:41.781667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 222/471] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:41 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:42.150898 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.152454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:42.166879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.167648 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.168680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.171699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.180425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.180425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.338242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.339851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: 2100ffca-f342-4973-862e-13a5ef53437f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:42.355650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.356512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.357101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.358369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.360809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.365839 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.411976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] HTTP exception thrown: Instance 2100ffca-f342-4973-862e-13a5ef53437f could not be found. Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Request method failure captured: Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f HTTP/1.1 Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaAWLQVhZ-h_M3dPPe3Ya6Mxr9mGf6Pm1k_OTmSNcT9JvxgSSiRK3jgI88Qn31lQwi-2_TIyRkOZDJF7Lh7japs61duBcAU8ZfLCb6810bthktwqUClgORGpnTVLJp11iDgGYSKGtDzwbqYZEpY6yPBQ9doCrIoDtWUWFPJFJh5_Aw8 Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 3cf3b9526fc541048f921613ded8ef2d Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-VolumesActionsTest-1045565331 Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:51:42.420923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-VolumesActionsTest-1045565331 Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 3cf3b9526fc541048f921613ded8ef2d Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-VolumesActionsTest-1045565331 Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-VolumesActionsTest-1045565331-project Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: ae04cdfc35964cf58502cefd1cc912e9 Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-VolumesActionsTest-1045565331-project Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 2100ffca-f342-4973-862e-13a5ef53437f could not be found. Aug 24 03:51:42.422503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '2100ffca-f342-4973-862e-13a5ef53437f'} Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2100ffca-f342-4973-862e-13a5ef53437f could not be found. Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:51:42.423607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2100ffca-f342-4973-862e-13a5ef53437f could not be found. Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2100ffca-f342-4973-862e-13a5ef53437f could not be found. Aug 24 03:51:42.425160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:51:42.426638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Returning 404 to user: Instance 2100ffca-f342-4973-862e-13a5ef53437f could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:51:42.426638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4267bd6a-1cbe-4bfa-b2d2-9c1586270488 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f" status: 404 len: 111 microversion: 2.1 time: 0.086411 Aug 24 03:51:42.444977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 223/472] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/2100ffca-f342-4973-862e-13a5ef53437f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:42.461176 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.461915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:42.487290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.487961 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.488859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.492357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:42.492357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:42.492357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:42.499287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:42.512182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0812201a-2a52-4eab-8fc2-00e3d9310465 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.362666 Aug 24 03:51:42.513425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 250/473] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:42.651971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-936769915", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "networks": [{"uuid": "f202f115-124c-4bc3-ae49-ec5d020c7956"}]}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:42.757176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] validate_networks() for [('f202f115-124c-4bc3-ae49-ec5d020c7956', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:42.941157 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:42.959431 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-45806792-5dbd-4fec-b791-c3decae79a20 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.502332 Aug 24 03:51:42.971246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 224/474] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:42.976158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:42.976912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:43.005205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.010440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.011206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.013273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.013930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.014418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.343414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.353795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.355383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.356811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-530b345b-6363-45f3-ad79-6182db14e8ed tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.384471 Aug 24 03:51:43.357572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 225/475] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:42 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:43.363604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.364210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:43.380026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.380428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.380892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.381590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.382069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.382524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.640719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.644426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:43.648945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5e08e5b4-c676-4cfa-843d-61f4c9f6bec8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.290203 Aug 24 03:51:43.649505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 226/476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:43.654493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.655092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:43.662997 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.663747 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.664448 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.665499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.666370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.667246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.705442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:43.705932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:43.706526 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:43.706794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:43.707210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:43.723047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.723047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.723047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.723047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:43.723401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:43.723487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:43.743834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Getting quotas for project 3cf3b9526fc541048f921613ded8ef2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:43.748592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Getting quotas for user ae04cdfc35964cf58502cefd1cc912e9 and project 3cf3b9526fc541048f921613ded8ef2d. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:43.755823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:43.771563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:43.774710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:43.888206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:43.897547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-97372c2a-d130-45d1-be80-f7452568e0f1 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.247011 Aug 24 03:51:43.898853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 227/477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:43.994612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-acac6769-e2bd-49c4-b403-e6cca99502c8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349028 Aug 24 03:51:43.996716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 251/478] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:51:43.997133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:43.998280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:44.007488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.008860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.010228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.013346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.015357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.017177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b89cd688-7740-4301-9c71-f899efb266f5 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:44.017836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b89cd688-7740-4301-9c71-f899efb266f5 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:44.018080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.202719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b89cd688-7740-4301-9c71-f899efb266f5 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.210947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b89cd688-7740-4301-9c71-f899efb266f5 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1213 microversion: 2.1 time: 0.208010 Aug 24 03:51:44.235873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 252/479] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:44 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:44.365479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:44.376831 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bc129d50-2023-4906-b58c-3cf674a1e5ca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.385776 Aug 24 03:51:44.377979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 228/480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:43 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:44.384925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:44.385921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:44.396252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.397214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.397945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.399050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.399767 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.400644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.680631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:44.681850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:44.693080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.693790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.694632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:44.697947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:44.698687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:44.700679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.069911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.084015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.084569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.086486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.088839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3148be33-5e8e-4eb5-a330-a5d955d5faa8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1737 microversion: 2.20 time: 0.710839 Aug 24 03:51:45.090350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 253/481] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:44 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1737 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:45.093795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7eb51830-ff8d-478a-9ab7-917d372b0559 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.425681 Aug 24 03:51:45.100778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-7b618937-9aca-44e0-b31a-2a618f4789b9 req-ac2a49aa-6295-4c38-8ee9-ed0ca403f684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928f3671-5aef-464f-8035-cc9ee087a394", "name": "network-vif-plugged", "status": "completed", "tag": "1a683477-a998-4ddb-8c06-dfa7486b6620"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:45.107051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 229/482] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:44 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:45.115087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7b618937-9aca-44e0-b31a-2a618f4789b9 req-ac2a49aa-6295-4c38-8ee9-ed0ca403f684 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.115979 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7b618937-9aca-44e0-b31a-2a618f4789b9 req-ac2a49aa-6295-4c38-8ee9-ed0ca403f684 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.116156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7b618937-9aca-44e0-b31a-2a618f4789b9 req-ac2a49aa-6295-4c38-8ee9-ed0ca403f684 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.126873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:45.127499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.131643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-7b618937-9aca-44e0-b31a-2a618f4789b9 req-ac2a49aa-6295-4c38-8ee9-ed0ca403f684 service nova] Creating event network-vif-plugged:1a683477-a998-4ddb-8c06-dfa7486b6620 for instance 928f3671-5aef-464f-8035-cc9ee087a394 on hv-cinder-85425 Aug 24 03:51:45.137163 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-7b618937-9aca-44e0-b31a-2a618f4789b9 req-ac2a49aa-6295-4c38-8ee9-ed0ca403f684 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045335 Aug 24 03:51:45.137816 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 254/483] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:45.140587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.141357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.141967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.142693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.143146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.143570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.238684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ac26179e-578d-475e-a257-a7b19b44cf12 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:45.239492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ac26179e-578d-475e-a257-a7b19b44cf12 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.308314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ac26179e-578d-475e-a257-a7b19b44cf12 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.316513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ac26179e-578d-475e-a257-a7b19b44cf12 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1213 microversion: 2.1 time: 0.083688 Aug 24 03:51:45.318721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 255/484] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:45 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:45.348858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.359492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3dbaac74-7b94-46c6-8298-7d9916a393bb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1372 microversion: 2.1 time: 0.251085 Aug 24 03:51:45.374476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 230/485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:45 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:45.400210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:45.401190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:45.414329 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.415398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.416076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.417033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:45.418007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:45.418840 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:45.574696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:45.601146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-aa945ab9-294d-41ad-bc16-7533296f45c8 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.206109 Aug 24 03:51:45.603021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 256/486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:45 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:46.117205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.118021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.120318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:46.121826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.123010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.126890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.127640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.128422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.129483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.130141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.131409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.135701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.136731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.138267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.140979 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.141708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.144277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.526395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.551367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.572660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.573879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-514bdd9d-589a-4afe-95c6-48918c691736 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.465181 Aug 24 03:51:46.577344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 231/487] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:46.598388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.599375 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.623190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.633678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.633678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.633678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.633678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.634068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.662420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.695865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-281c9d31-13ff-480a-8c66-6feaf9466072 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.580749 Aug 24 03:51:46.711376 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 257/488] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:46.720939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.721719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.731171 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.732018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.733435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.734350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.735173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.736315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.743331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:46.754467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-97bde452-51a7-4f94-b332-1195d2b5d36b tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1217 microversion: 2.1 time: 0.170053 Aug 24 03:51:46.755051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 232/489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:46.759784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:46.760394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:46.766972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.767679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.768126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:46.769018 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:46.769629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:46.770250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.064930 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:47.073133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a1ff6032-e61c-46d4-a464-9835654f04ed tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1566 microversion: 2.1 time: 0.360541 Aug 24 03:51:47.087106 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 258/490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1566 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:47.097478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:47.103887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4559c21d-be5e-4d0d-94d3-bc6cad54d92c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.347541 Aug 24 03:51:47.116157 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 233/491] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:46 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:47.116530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:47.116530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:47.132035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.133170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.133686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.135320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.136496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.137080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.233695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-eaf05177-9e98-4567-a96c-46ab6907e79f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127280 Aug 24 03:51:47.238189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 259/492] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:51:47 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:47.601918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:47.602569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:47.617315 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.617821 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.618298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.619025 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.620754 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.622023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.716798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:47.717985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:47.736571 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.737077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.737526 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:47.738285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:47.738756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:47.739192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.065554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.066202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.080791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-44a8003b-ba8f-434d-9571-305d7d38fbeb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.367656 Aug 24 03:51:48.081887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 260/493] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:47 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:48.082785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.084963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.086501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aa5c4112-e3b7-4c7f-affb-a16268db1523 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.488508 Aug 24 03:51:48.088613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:48.089520 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:48.102730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 234/494] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:47 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:48.104346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.104930 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.105376 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.106084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.106569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.106992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.129162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:48.129778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:48.139673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.140163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.141138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.145475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.146236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.148130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.293705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.301545 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0c2bc232-ec67-498a-89be-d7e77638a8d8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1209 microversion: 2.1 time: 0.218328 Aug 24 03:51:48.315796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 261/495] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:48 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1209 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:48.457001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:48.470071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5b7dafca-de64-42f5-a9e5-e8e850e10365 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.345268 Aug 24 03:51:48.474031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 235/496] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:48 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:48.881333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-d9695ef4-44d9-41fc-9e7a-aa43a313fbf9 req-a640156e-7dec-4da0-aba6-a3a11685c2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611ffff0-163e-4c5f-83be-b31e72dd599c", "tag": "0d9a4992-1d7c-44c3-aefb-900ad718be1f"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:48.891945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d9695ef4-44d9-41fc-9e7a-aa43a313fbf9 req-a640156e-7dec-4da0-aba6-a3a11685c2b9 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:48.892418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d9695ef4-44d9-41fc-9e7a-aa43a313fbf9 req-a640156e-7dec-4da0-aba6-a3a11685c2b9 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:48.892853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d9695ef4-44d9-41fc-9e7a-aa43a313fbf9 req-a640156e-7dec-4da0-aba6-a3a11685c2b9 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:48.910338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-d9695ef4-44d9-41fc-9e7a-aa43a313fbf9 req-a640156e-7dec-4da0-aba6-a3a11685c2b9 service nova] Creating event network-changed:0d9a4992-1d7c-44c3-aefb-900ad718be1f for instance 611ffff0-163e-4c5f-83be-b31e72dd599c on hv-cinder-85425 Aug 24 03:51:48.921249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-d9695ef4-44d9-41fc-9e7a-aa43a313fbf9 req-a640156e-7dec-4da0-aba6-a3a11685c2b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043466 Aug 24 03:51:48.923130 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 262/497] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:49.104684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:49.107231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:49.113473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:49.114435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:49.118046 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.118889 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.119571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.120590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.121435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.122100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.122273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.123027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.123690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.124607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.125303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.126354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.355979 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.370303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.379156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-24fc73dc-468c-4c0a-aa7c-da4f10b84ba7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.280378 Aug 24 03:51:49.380118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 236/498] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:49 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:49.380364 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.381882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.383083 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f97b9d38-b699-4b14-8637-2d432680650d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.275204 Aug 24 03:51:49.384762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:49.385625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:49.396163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.396982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.397638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.398618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.399289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.399947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.402317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 263/499] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:49 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:49.497020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:49.497796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:49.518423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.518920 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.519359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.520081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:49.529985 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:49.533132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:49.571368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:49.583300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.592116 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a4e5d0bd-1995-44bb-bf3f-7b388556b552 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1265 microversion: 2.1 time: 0.210774 Aug 24 03:51:49.601508 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 237/500] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:49 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:49.820360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:49.830990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d6b9b0cb-3457-4e01-b9a6-b0e0fed23987 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.337969 Aug 24 03:51:49.832201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 264/501] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:49 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:49.905618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1472600077", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:49.970123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] validate_networks() for None {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:51:50.413238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:50.415428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:50.427806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.428621 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.429433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.432115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.433131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.433954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.615745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:51:50.616238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:51:50.616646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:51:50.617961 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:51:50.623859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:51:50.667090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.668393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.674060 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.675211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:50.679767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:50.680865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:50.751373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Getting quotas for project 618d4ab58d984c78a68a69f393118927. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:50.767767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Getting quotas for user 2791e367943d4e1eaddd0f0f930ad8c1 and project 618d4ab58d984c78a68a69f393118927. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:50.798786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:51:50.801203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:51:50.998309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cd7a2a42-d4ff-439f-a7f0-10fae7286ddd tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096693 Aug 24 03:51:51.004142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.007900 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 238/502] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:51:51.012958 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-787bd341-8b85-40e4-b51c-ba516f2b5fb6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1367 microversion: 2.1 time: 0.615264 Aug 24 03:51:51.014818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 265/503] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:50 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:51.021365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-1e2174e9-4d8c-4962-84e7-fb55946018f1 req-82d04821-42cc-4dd5-af86-b54d03772a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "name": "network-vif-unplugged", "status": "completed", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:51.035581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:51.036633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:51.037881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1e2174e9-4d8c-4962-84e7-fb55946018f1 req-82d04821-42cc-4dd5-af86-b54d03772a22 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.038412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1e2174e9-4d8c-4962-84e7-fb55946018f1 req-82d04821-42cc-4dd5-af86-b54d03772a22 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.038845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1e2174e9-4d8c-4962-84e7-fb55946018f1 req-82d04821-42cc-4dd5-af86-b54d03772a22 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.070920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.071671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.072320 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.073350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.074013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.074673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.078970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-1e2174e9-4d8c-4962-84e7-fb55946018f1 req-82d04821-42cc-4dd5-af86-b54d03772a22 service nova] Creating event network-vif-unplugged:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:51:51.089243 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-1e2174e9-4d8c-4962-84e7-fb55946018f1 req-82d04821-42cc-4dd5-af86-b54d03772a22 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071789 Aug 24 03:51:51.089849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 266/504] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:51.096991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:51.113563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:51.125615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.126038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.126506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.127220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.141789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.150946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.266346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.296484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.301235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.306311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fda06408-de97-496f-a60a-8add1ad7a6c6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.295235 Aug 24 03:51:51.311530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 239/505] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:51 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:51.323531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:51.331091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:51.342492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.343131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.344587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.346640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:51.349363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:51.349891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:51.375929 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.393049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-49b4b641-05e8-4d69-baab-406404239971 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1265 microversion: 2.1 time: 0.300680 Aug 24 03:51:51.394139 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 267/506] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:51 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:51.405704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d8a28913-72b9-49c2-b3c2-8dd57afd9e4a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:51.424110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d8a28913-72b9-49c2-b3c2-8dd57afd9e4a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:51.574468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d8a28913-72b9-49c2-b3c2-8dd57afd9e4a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.585618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d8a28913-72b9-49c2-b3c2-8dd57afd9e4a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1215 microversion: 2.1 time: 0.190251 Aug 24 03:51:51.587660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 268/507] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:51 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:51.631068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:51.647991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b36c993e-15e2-4a27-8d96-37d08408c428 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.331825 Aug 24 03:51:51.648673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 240/508] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:51 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:52.036853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.037573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.046352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.047424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.047876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.048619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.049092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.049524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.225166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.246268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7f35dc9d-7b2f-43bc-be2b-6ff2fc3edede tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1558 microversion: 2.1 time: 0.213325 Aug 24 03:51:52.246862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 269/509] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:52.271421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.272207 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.280047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.282076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.282772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.283833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.284548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.285193 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.337861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.338998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.352387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.353117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.355370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.356657 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.359806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.360975 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.426764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d808b3b2-c39d-4e24-88ec-5c45168939b2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161248 Aug 24 03:51:52.427780 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 241/510] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:52.434404 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.452045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.478441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.479763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.480235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.480984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.481441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.481872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.615667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.632933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dfa5d25a-eb0f-45a3-9c76-df443f95c2a6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1273 microversion: 2.1 time: 0.204007 Aug 24 03:51:52.633532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 242/511] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:52.646073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-36491cdb-9e9c-486d-9833-5a9d2f58286f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.646721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-36491cdb-9e9c-486d-9833-5a9d2f58286f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.666746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.676174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.677951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.679078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b481282b-0e59-467f-88a6-14fca70620fd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.345257 Aug 24 03:51:52.708645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 270/512] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:51:52.719192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:52.719964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:52.726612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-36491cdb-9e9c-486d-9833-5a9d2f58286f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.727104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.727770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.728365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.729411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:52.730320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:52.731751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:52.736469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-36491cdb-9e9c-486d-9833-5a9d2f58286f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1215 microversion: 2.1 time: 0.099367 Aug 24 03:51:52.738292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 243/513] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:52.915449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:52.925806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c4710916-b514-4b73-a37e-375143e84ff1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.215933 Aug 24 03:51:52.926970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 271/514] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:52 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:53.667161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:53.667936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:53.677217 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.678247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.678698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.679446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.679908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.680338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.707056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:53.708372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:53.717102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.720265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.720265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.720265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.720265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.721352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.746118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:53.759611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:53.769430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-87151d7f-de4e-4619-9cc4-82faa1078e05 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1273 microversion: 2.1 time: 0.106561 Aug 24 03:51:53.778293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 244/515] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:53 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:53.778293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:53.778293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:53.786578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.792012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.792012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.792012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.792012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.792386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.820382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:53.879981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:53.888042 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-899bfcd6-edde-4e8c-a862-f0923dc2d580 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1219 microversion: 2.1 time: 0.116257 Aug 24 03:51:53.893368 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 245/516] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:53 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:53.913950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:53.923937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:53.925499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:53.927693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0221c286-3216-469c-bfe6-c0faec3fc3be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.225918 Aug 24 03:51:53.928681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 272/517] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:53 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:53.948153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:53.948768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:53.956262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.956793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.957673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:53.957953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:53.958449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:53.958958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.149811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:54.159999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f06dd2eb-733c-47f7-aab5-8ba7da33e3dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.215559 Aug 24 03:51:54.162535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 246/518] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:53 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:54.491172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-1ea36cec-cb15-463f-a7fe-c975f2f2cbca req-b6bf4c8b-ab91-4f13-9b1f-1c68950db5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928f3671-5aef-464f-8035-cc9ee087a394", "tag": "1a683477-a998-4ddb-8c06-dfa7486b6620"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:54.523935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-1ea36cec-cb15-463f-a7fe-c975f2f2cbca req-b6bf4c8b-ab91-4f13-9b1f-1c68950db5db service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.533214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-1ea36cec-cb15-463f-a7fe-c975f2f2cbca req-b6bf4c8b-ab91-4f13-9b1f-1c68950db5db service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.534662 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-1ea36cec-cb15-463f-a7fe-c975f2f2cbca req-b6bf4c8b-ab91-4f13-9b1f-1c68950db5db service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.592254 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-1ea36cec-cb15-463f-a7fe-c975f2f2cbca req-b6bf4c8b-ab91-4f13-9b1f-1c68950db5db service nova] Creating event network-changed:1a683477-a998-4ddb-8c06-dfa7486b6620 for instance 928f3671-5aef-464f-8035-cc9ee087a394 on hv-cinder-85425 Aug 24 03:51:54.614977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-1ea36cec-cb15-463f-a7fe-c975f2f2cbca req-b6bf4c8b-ab91-4f13-9b1f-1c68950db5db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127294 Aug 24 03:51:54.616213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 247/519] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:54.793057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:54.793986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:54.813633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.815071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.816028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.817451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.818476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.819645 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.853774 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-934b5a98-d26a-4469-a77f-d7d5e0a7e166 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Action: 'create', calling method: .version_select at 0x7f6c137d91f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1056783115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF8Qj7FS/H2U8LZ8fxEkrpVgs76pvlxZDYnSjWeRsPWea9oJ5lagk3fYNRjF0Fl2oKaqCFpkHhMigmVFBIDVh4m1UfFIHVYR08R/ph8PvNUO2jpxz4EH8kZwBgrnKyj5g=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:54.883226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-934b5a98-d26a-4469-a77f-d7d5e0a7e166 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:51:54.887990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-934b5a98-d26a-4469-a77f-d7d5e0a7e166 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for user 71ff73cade8b42c7ae57be1e3ef0e028 and project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:51:54.918806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:54.927987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f492e887-7fe2-4b64-b7db-9164f7fcf69f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1273 microversion: 2.1 time: 0.140371 Aug 24 03:51:54.928583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 248/520] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:54 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:54.934175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:54.934804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:54.944294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.949881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.949881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:54.949881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:54.949881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:54.950438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.003327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-934b5a98-d26a-4469-a77f-d7d5e0a7e166 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.518712 Aug 24 03:51:55.013137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 273/521] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:51:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:51:55.020715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:55.022458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:55.023143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:55.031775 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-927e54bd-cebe-489f-ba55-5617feef3302 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1219 microversion: 2.1 time: 0.101804 Aug 24 03:51:55.032446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 249/522] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:54 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:55.052050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.057639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.057639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.057639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.057639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.058011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.185498 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:55.189601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:55.196519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.197456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.197938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.198722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.199171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.199765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.223520 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:55.235878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:55.237644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:55.239125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e95604e5-6835-49b3-940a-524a6ca23dbc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1719 microversion: 2.20 time: 0.224828 Aug 24 03:51:55.240714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 274/523] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:55 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:55.403020 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:55.420117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-668a92e7-4cc9-4e47-94c8-c420d35a30d9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.239226 Aug 24 03:51:55.421270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 250/524] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:55 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:55.951079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:55.951702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:55.968093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.974598 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.977007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:55.977897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:55.980562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:55.981205 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.053483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:56.054043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:56.069502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.070208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.070673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.071432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.071897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.072395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.122856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.136511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-047a5233-c1bf-445a-a1e9-497a5e0acb75 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1273 microversion: 2.1 time: 0.188658 Aug 24 03:51:56.138446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 275/525] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:55 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:56.267505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:56.268467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:56.274008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.279156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.279817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.283602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.285026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.285346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.285878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.312548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-05697840-62e9-472c-8694-f573c35b837b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1219 microversion: 2.1 time: 0.261928 Aug 24 03:51:56.314818 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 251/526] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:56 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1219 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:56.454733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:56.458025 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:56.491166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.491667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.495989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.498189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.500914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.516405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.527815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.543612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.545327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.550638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-85abc02a-912c-4633-b26f-cd43a37637ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1722 microversion: 2.20 time: 0.288139 Aug 24 03:51:56.553170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 276/527] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:56 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:56.583441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0881a278-5bc1-49ba-932a-bf175adf06cd"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:56.586026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:56.605211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.605694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.608727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.610442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:56.611018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:56.611458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:56.912819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:56.926715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6f35aa2d-0492-40ef-a966-3b5df6afffb4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.477639 Aug 24 03:51:56.928881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 252/528] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:56 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:57.159267 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:57.160637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:57.168184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.168672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.169105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.169806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.170294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.170738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.466652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:57.474377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f80abe74-1244-435e-a87e-aca1792a4244 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.320599 Aug 24 03:51:57.474946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 253/529] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:57 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:57.479564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:57.480566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:57.489888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.490517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.491059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.491769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.492222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.492963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.570863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:57.581086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a7c04a1b-9596-45f8-9aec-c0b026061417 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1267 microversion: 2.1 time: 0.105075 Aug 24 03:51:57.586220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 254/530] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:57 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:57.984053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:57.984053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:57.984053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.984053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.985451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:57.985451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:57.985451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:57.985451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.116373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:58.125915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d01edde0-aa0c-4023-9f45-f225e6b673dc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.177806 Aug 24 03:51:58.126534 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 255/531] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:57 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:58.283986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dca15a22-63fb-40db-bc4a-77da9c84670d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.705043 Aug 24 03:51:58.285224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 277/532] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 24 03:51:56 2022] POST /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments => generated 188 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:51:58.425830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:51:58.428567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:58.433770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.434405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.434947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.435720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.436246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.436760 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.482779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127736) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:51:58.504633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:58.505953 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:58.512056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.512618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.513149 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.513921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.514485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.515020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.684657 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:58.692402 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-24ab65a9-640e-4c69-9fce-13a937668511 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.198090 Aug 24 03:51:58.692955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 278/533] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:58 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:58.697918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:58.698747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:58.704741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.705220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.705651 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.706380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:58.721657 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:58.721657 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:58.776832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:58.785471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-33de4665-5366-4296-8573-9c2fd0b98495 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1267 microversion: 2.1 time: 0.091326 Aug 24 03:51:58.786048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 279/534] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:58 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:51:59.148309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.148925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.156640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.157230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.157891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.158804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.159261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.159707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.176589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-875909c2-10d1-412e-ac0d-48d80cc04483 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/action" status: 202 len: 0 microversion: 2.20 time: 0.756321 Aug 24 03:51:59.181164 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 256/535] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 03:51:58 2022] POST /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:51:59.192692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.192692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.194753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.195003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.195426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.196312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.196774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.197203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.382433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.393346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-85764358-aa0d-471a-a022-a9b41d0b464d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.249085 Aug 24 03:51:59.393947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 280/536] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:59.421384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.433551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.435150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.436551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2119a7bb-79f5-4bb3-a115-8d706cfca2bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1808 microversion: 2.20 time: 0.254170 Aug 24 03:51:59.437651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 257/537] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:51:59.712875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.713497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.726531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.727303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.727750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.728518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.729157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.729587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.734560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:59.808012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:51:59.808976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:51:59.816326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.816806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.817492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.818610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:51:59.819098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:51:59.819537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:51:59.893400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.901333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:51:59.902732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e5563e94-5c89-4465-b248-5ca2efe849aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1267 microversion: 2.1 time: 0.098851 Aug 24 03:51:59.903415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 258/538] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:51:59.909790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dd93c846-ff39-41b3-ad7a-28d33cf6c6aa tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.200787 Aug 24 03:51:59.911721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 281/539] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:51:59 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:00.418255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.421176 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.429520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.430007 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.430514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.431218 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.431670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.432102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.465278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.465997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.474200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.476779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.476779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.476779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.476779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.477123 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.706488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:00.765691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:00.799225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8eb6e94a-ec7e-4624-9ed5-ea8c6e72c7fa tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.385692 Aug 24 03:52:00.800474 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 259/540] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:00.830405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:00.843000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:00.845502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:00.847044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4c29a96c-3906-4e31-8677-e69e88d9b22e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1808 microversion: 2.20 time: 0.385743 Aug 24 03:52:00.848039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 282/541] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1808 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:00.924702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.925441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.936018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:00.936807 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:00.945740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.946801 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.947288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.947401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.947724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.947941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.948442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.948685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:00.948884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.949145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:00.949303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:00.949581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.074556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:01.085156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7942bdb9-719d-4d18-95f7-64e10ee45793 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1267 microversion: 2.1 time: 0.164976 Aug 24 03:52:01.086442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 260/542] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:01.213556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:01.221802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a535a6ee-149c-4a3b-9d30-b29e754c6d1a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.290802 Aug 24 03:52:01.222664 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 283/543] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:00 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:01.722857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-2fedb971-0e80-4ef5-9a7e-fe83b4e74087 req-10d85030-f0d6-4170-9f52-30c3cde59d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4d3788e-697f-4045-9fb4-05599b92c0ff", "tag": "bbbf9c99-3582-402d-aa7c-12c62c616005"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:01.733525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-2fedb971-0e80-4ef5-9a7e-fe83b4e74087 req-10d85030-f0d6-4170-9f52-30c3cde59d9b service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.734184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-2fedb971-0e80-4ef5-9a7e-fe83b4e74087 req-10d85030-f0d6-4170-9f52-30c3cde59d9b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.736030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-2fedb971-0e80-4ef5-9a7e-fe83b4e74087 req-10d85030-f0d6-4170-9f52-30c3cde59d9b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.754947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-2fedb971-0e80-4ef5-9a7e-fe83b4e74087 req-10d85030-f0d6-4170-9f52-30c3cde59d9b service nova] Creating event network-changed:bbbf9c99-3582-402d-aa7c-12c62c616005 for instance f4d3788e-697f-4045-9fb4-05599b92c0ff on hv-cinder-85425 Aug 24 03:52:01.761995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-2fedb971-0e80-4ef5-9a7e-fe83b4e74087 req-10d85030-f0d6-4170-9f52-30c3cde59d9b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043076 Aug 24 03:52:01.763234 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 261/544] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:01.822808 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:01.823729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:01.841402 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.841888 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.842442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.843264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.843771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.844336 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.873757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:01.873757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:01.879984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.880429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.880893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.881606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:01.882748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:01.883358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:01.905288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:02.196683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.206213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-46774cec-b4fb-422c-8a0a-20fdc68d6e3d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.388791 Aug 24 03:52:02.206867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 284/545] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:01 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:02.211949 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:02.212741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:02.219859 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:02.220153 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:02.220593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.221492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:02.222039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:02.222577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.241104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.251563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.253464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.254697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6737ada8-3529-4f3e-9832-59240dd6b159 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.386989 Aug 24 03:52:02.255601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 262/546] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:01 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:02.260785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:02.262093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:02.276999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:02.278607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:02.279133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.293005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:02.293005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:02.293005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:02.362540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.378647 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-834fa312-d6d1-4454-948f-ebb82161d358 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1285 microversion: 2.1 time: 0.169037 Aug 24 03:52:02.391128 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 285/547] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:02 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:02.569367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:02.579528 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ecf8535e-ae8f-4afd-85d0-19b03b660566 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.321590 Aug 24 03:52:02.579528 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 263/548] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:02 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:03.230433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.231057 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:03.237741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.238255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.238757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.239495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.239955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.240385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.300593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.301396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:03.307783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=8 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:03.310275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.310867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.311518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.313458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.313964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.314367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.446949 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.459025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-02e29f7a-5368-476e-aaa9-fb74a6e4fb78 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.232035 Aug 24 03:52:03.473469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 286/549] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:03.478532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.479356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:03.486559 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.487119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.487587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.488335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.488814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.489269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.526125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.536871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.538521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.539945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-face7d32-eee3-42c8-88cb-a79c5dc03192 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.243427 Aug 24 03:52:03.541376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 264/550] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:03.603238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:03.603726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:03.615150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.615644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.616080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.616798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:03.617442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:03.617869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:03.691856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.700843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-839234d7-a7ba-4231-bd82-1127250da70c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.226036 Aug 24 03:52:03.701718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 287/551] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:03.807951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:03.817971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-319cff90-00fd-4a69-9581-00828a33451a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.219800 Aug 24 03:52:03.818579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 265/552] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:03 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:04.480741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.482087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:04.490017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.490524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.490957 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.491680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.492297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.492719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.566319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.566940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:04.573427 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.573912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.574384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.575086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.575543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.575966 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.688546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.697073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ffbc228c-8170-4b7e-8173-71140f15588f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.220239 Aug 24 03:52:04.697698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 288/553] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:04.723955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.724601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:04.735383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.735383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.735383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.735383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.736116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.736116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.757016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.766720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.768919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.770108 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-700e5d30-fe8f-43a0-8a3e-7a75e3e812af tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.209343 Aug 24 03:52:04.770953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 266/554] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:04.838684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:04.839349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:04.846073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.846602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.847047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.847750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:04.848202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:04.848627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:04.888716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:04.898662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9565cc24-4604-478e-89d8-66726e239084 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.178414 Aug 24 03:52:04.899311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 289/555] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:04.992129 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:05.001009 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ddd62edb-d3f6-4253-ae7a-16b1b1c5fe16 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.166077 Aug 24 03:52:05.001655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 267/556] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:04 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:05.721119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.721720 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:05.723821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=16 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:05.725023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:05.730238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.730754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.731301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.732030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.732599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.733033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.793376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.794082 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:05.801497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.802062 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.803689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.803689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.803689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.804083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.937944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:05.946682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-117bde2f-2eee-4938-9af9-2ceb8ecb6565 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.230627 Aug 24 03:52:05.947288 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 290/557] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:05.951753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:05.952414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:05.958683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.959359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.959977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.960849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:05.961470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:05.961899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:05.991164 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:06.000833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:06.002826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:06.004106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1d1842b7-de4d-49f7-9f83-7c1419a2610e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.214749 Aug 24 03:52:06.005213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 268/558] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:06.022530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:06.023337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:06.029591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:06.030125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:06.030644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:06.031555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:06.032177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:06.032846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:06.147708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:06.158343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-afeeef01-8e4a-4ea6-b422-0e3959714acc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.209794 Aug 24 03:52:06.158992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 291/559] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:05 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:06.195283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:06.203238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8c1a8c7b-5f8d-4472-b317-021157e6e0c9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.184622 Aug 24 03:52:06.203802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 269/560] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:06 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:06.970997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:06.973329 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:06.986654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:06.987734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:06.988412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:06.991543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:06.992091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:06.992596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.032309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:07.033236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:07.036705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:07.040410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.040908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.041345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.042289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.042750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.043175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.326266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.329900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1a3346a7-b29c-4188-b9cf-7025bedab7c6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1724 microversion: 2.1 time: 0.364610 Aug 24 03:52:07.330699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 292/561] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:06 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:07.335202 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:07.335836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:07.348818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.349361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.349870 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.350626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.351102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.351559 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.377183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.390326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.392218 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.393475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ffbc5c54-10fd-4334-bef9-421408cbc6e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.365631 Aug 24 03:52:07.408289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 270/562] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:07 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:07.416807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:07.417429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:07.424600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.425444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.426103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.427179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:07.427828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:07.428778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:07.967154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.970595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:07.981506 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2b8973e5-171e-4982-86cd-d871021e442a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.571607 Aug 24 03:52:07.982803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 271/563] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:07 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:07.988744 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-9d4159a1-9b52-477e-815f-48ca3fa7384c req-bc34958c-7650-4e40-a95d-a2873b84f0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069", "tag": "dcfe2060-ccc1-4d2c-8209-5005cab9521a"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:08.001038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fd5741c9-c81b-4d3d-b627-5db5f044a3dc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.664227 Aug 24 03:52:08.001861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-9d4159a1-9b52-477e-815f-48ca3fa7384c req-bc34958c-7650-4e40-a95d-a2873b84f0e3 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.001861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-9d4159a1-9b52-477e-815f-48ca3fa7384c req-bc34958c-7650-4e40-a95d-a2873b84f0e3 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.002143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-9d4159a1-9b52-477e-815f-48ca3fa7384c req-bc34958c-7650-4e40-a95d-a2873b84f0e3 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.007816 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 293/564] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:07 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:08.021719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-9d4159a1-9b52-477e-815f-48ca3fa7384c req-bc34958c-7650-4e40-a95d-a2873b84f0e3 service nova] Creating event network-changed:dcfe2060-ccc1-4d2c-8209-5005cab9521a for instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 on hv-cinder-85425 Aug 24 03:52:08.029799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-9d4159a1-9b52-477e-815f-48ca3fa7384c req-bc34958c-7650-4e40-a95d-a2873b84f0e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045515 Aug 24 03:52:08.031604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 272/565] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:08.358519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:08.359362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:08.365561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.366048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.366525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.367224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.367689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.368117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.421995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:08.423055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:08.429740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.434288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.434741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.435490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.435947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.436373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.555473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:08.565073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4b923120-4a0b-4665-a6d5-76c2150f366e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1701 microversion: 2.1 time: 0.214270 Aug 24 03:52:08.565648 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 294/566] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:08 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1701 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:08.590812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e5fc719c-e2d0-4793-bdb5-1d6ad5afe9e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:08.598046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e5fc719c-e2d0-4793-bdb5-1d6ad5afe9e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.598755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e5fc719c-e2d0-4793-bdb5-1d6ad5afe9e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.599191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e5fc719c-e2d0-4793-bdb5-1d6ad5afe9e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.605800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:08.615739 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:08.618690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:08.619533 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5cddb420-2782-4967-a403-53c8fb3244f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.202290 Aug 24 03:52:08.620109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 273/567] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:08 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:08.665906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e5fc719c-e2d0-4793-bdb5-1d6ad5afe9e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Going to try to start instance {{(pid=127737) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:52:08.930569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e5fc719c-e2d0-4793-bdb5-1d6ad5afe9e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action" status: 202 len: 0 microversion: 2.1 time: 0.343219 Aug 24 03:52:08.931379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 295/568] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:52:08 2022] POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:52:08.943152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:08.943771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:08.951252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.953273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.953273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:08.953882 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:08.954372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:08.954817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.015286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:09.016373 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:09.022995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.023577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.027742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.027742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.027742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.027742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.133069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.142590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-171815c4-b097-4f38-aa85-d279015bf13d tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.205745 Aug 24 03:52:09.143182 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 274/569] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:08 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:09.147845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:09.148457 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:09.154971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.156416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.156967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.158181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.161184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.161184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.196251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.199819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:09.205500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9a9d270-2287-42ff-b602-dade0e4eadbf tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.195656 Aug 24 03:52:09.206125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 296/570] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:09 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:09.300487 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.309108 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a47f9208-c142-4cc6-bd94-8ca0df8f58ea tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.164861 Aug 24 03:52:09.309690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 275/571] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:09 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:09.644448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:09.645059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:09.651369 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.651852 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.652294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.652993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:09.653439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:09.653871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:09.801975 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.810550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.812689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:09.814027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c7dc860f-1581-4df2-9258-8de01bef7ddf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.174371 Aug 24 03:52:09.814677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 297/572] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:09 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:10.168906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:10.169742 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:10.177365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.177861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.178340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.179049 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.179503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.179931 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.227452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:10.228317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:10.235434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.236302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.236480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.237248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.237735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.240301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.388082 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:10.397921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8069c5c5-d88e-435c-8065-c10ca20fe3ab tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.232789 Aug 24 03:52:10.399175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 276/573] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:10 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:10.403654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:10.404221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:10.411615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.411854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.412522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.413522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.414308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.415028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.419383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:10.431541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bea4a9a2-f918-46c9-837d-3a087c3b28e8 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.207917 Aug 24 03:52:10.432347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 298/574] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:10 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:10.563141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:10.572447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f52c22fa-72c7-4bc9-ab6a-3f803622ad9e tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.172662 Aug 24 03:52:10.573233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 277/575] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:10 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:10.839507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:10.840308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:10.848718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.849339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.849822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:10.850698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:10.851299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:10.851839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.000303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.009977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.011512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.012695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-172315ee-5354-43ef-bd86-0907904df575 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.178328 Aug 24 03:52:11.013257 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 299/576] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:10 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:11.430333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:11.430879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:11.439271 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.439758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.444807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.444807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.444807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.444807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.454557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:11.455227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:11.462104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.462630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.463069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.463775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.464253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.464680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.675330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.684520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-daed223e-c1c3-40f5-862b-d65b95ea19a1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.257947 Aug 24 03:52:11.684800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.685104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 278/577] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:11 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:11.691122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:11.691753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:11.694129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9bf6ffd-8cab-4492-aec4-3af754f9885f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.244432 Aug 24 03:52:11.694741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 300/578] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:11 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:11.698360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.698851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.699286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.703653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:11.703653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:11.703653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:11.844977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:11.849374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:11.854800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-20df5c35-67f3-42f7-bbba-d6b9081af8ec tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.168394 Aug 24 03:52:11.855391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 279/579] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:11 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:12.036960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:12.037597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:12.043716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.044195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.044633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.045338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.046341 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.046934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.181281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.191836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.193406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.194603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2edc4c93-bd93-4915-b5b9-eeb987a645b5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.161606 Aug 24 03:52:12.195163 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 301/580] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:12 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:12.709111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:12.709746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:12.716905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.717390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.718031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.718654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:12.719127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.719127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.719421 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:12.719535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.727490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.728078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.728632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.729484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.730132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.730733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.934561 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.943708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-04bd78a7-e3a2-4742-8f13-e1332ca86ee6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.238409 Aug 24 03:52:12.944423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 280/581] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:12 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:12.948665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:12.949501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:12.950239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:12.956742 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.957244 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.957685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.958442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:12.958901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:12.959334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:12.959906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-330e18e8-faa6-4c22-9137-1e84ae7508d9 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.246625 Aug 24 03:52:12.960608 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 302/582] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:12 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:13.109075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:13.117040 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-07d84ba6-c19d-4257-9332-42c953ddc58f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.171537 Aug 24 03:52:13.117606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 281/583] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:12 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:13.219119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:13.219847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:13.225927 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.226456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.226909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.227649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.228116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.228558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.381517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:13.390856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:13.392382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:13.393578 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-13750866-a21d-4a5c-a2b9-235e06254728 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.179670 Aug 24 03:52:13.394137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 303/584] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:13 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:13.965482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:13.966217 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:13.973425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.973910 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.974390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.975098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.975584 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.976030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.982414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:13.983061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:13.989879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.990510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.991011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:13.991804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:13.992333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:13.992857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:14.223454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.228044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.236578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2adefef2-b1bb-4e15-84eb-5e322c96da1b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.274983 Aug 24 03:52:14.236869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-714bc327-9d45-44da-8f17-858e024097c2 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.258551 Aug 24 03:52:14.248072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 304/585] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:13 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:14.249401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 282/586] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:13 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:14.255868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:14.256678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:14.263008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:14.266138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:14.266138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:14.266138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:14.266138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:14.266746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:14.426377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:14.427365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:14.440623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:14.442752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:14.443867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.447058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:14.448608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:14.450023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:14.450765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:14.465105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-07e17fbd-dc42-4688-9531-513292661b2b tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.212751 Aug 24 03:52:14.465972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 305/587] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:14 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:14.733517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.748196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.750835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:14.752127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2f903488-baa5-4219-8cfd-ca49d48556fa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1750 microversion: 2.20 time: 0.332319 Aug 24 03:52:14.758198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 283/588] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:14 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1750 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:15.259478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.260219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.260570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.260668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.267982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.268195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.268543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.268792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.268990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.269202 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.269748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.269885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.270138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.270694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.270885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.271136 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.480422 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.484180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.492950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ec617a4b-b316-4ee7-b59f-793528d3579a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.237364 Aug 24 03:52:15.493804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 306/589] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:15.494257 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3ce30a44-b69f-4321-90dc-9050b4a29eca tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.238660 Aug 24 03:52:15.494841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 284/590] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:15.500615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.501549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.508213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.508960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.509405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.510121 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.510617 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.511041 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.651518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.660281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8c55ba8f-26cd-4e50-b6c1-4390566c69d1 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.164912 Aug 24 03:52:15.660867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 307/591] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:15.779386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:15.780015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:15.786452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.786968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.787409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.788112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:15.788569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:15.788998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:15.930964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.940900 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.942455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:15.943625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c3dbd866-28b1-4260-8f4b-a526efe17af2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.168415 Aug 24 03:52:15.944190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 285/592] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:15 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:16.519939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.520567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.521299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.522624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.527828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.528409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.533299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.533299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.533299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.533299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.533694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.533694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.533694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.535723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.535723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.535723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.757432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:16.762316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:16.768882 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-592a34c6-97e6-4f96-87c4-5e9a7bdc8407 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.254498 Aug 24 03:52:16.769764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 286/593] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:16.775321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.776011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.783078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.783870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.784643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.785557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.786263 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.787085 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.788020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-673a7b30-2adf-4714-b94f-228eb6d32fee tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.275364 Aug 24 03:52:16.788784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 308/594] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:16.825370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-7415e6ea-99ce-49ba-abdc-e0cc07f8a2b1 req-0c1fd180-f0f9-41ce-b928-2c54eba8ad5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d3788e-697f-4045-9fb4-05599b92c0ff", "name": "network-vif-plugged", "status": "completed", "tag": "bbbf9c99-3582-402d-aa7c-12c62c616005"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:16.837473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7415e6ea-99ce-49ba-abdc-e0cc07f8a2b1 req-0c1fd180-f0f9-41ce-b928-2c54eba8ad5b service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.837984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7415e6ea-99ce-49ba-abdc-e0cc07f8a2b1 req-0c1fd180-f0f9-41ce-b928-2c54eba8ad5b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.839687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-7415e6ea-99ce-49ba-abdc-e0cc07f8a2b1 req-0c1fd180-f0f9-41ce-b928-2c54eba8ad5b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.853048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-7415e6ea-99ce-49ba-abdc-e0cc07f8a2b1 req-0c1fd180-f0f9-41ce-b928-2c54eba8ad5b service nova] Creating event network-vif-plugged:bbbf9c99-3582-402d-aa7c-12c62c616005 for instance f4d3788e-697f-4045-9fb4-05599b92c0ff on hv-cinder-85425 Aug 24 03:52:16.859299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-7415e6ea-99ce-49ba-abdc-e0cc07f8a2b1 req-0c1fd180-f0f9-41ce-b928-2c54eba8ad5b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039014 Aug 24 03:52:16.860282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 309/595] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:16.942803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:16.952596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-57661683-30e7-43c2-a151-21c5adace9fa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.180590 Aug 24 03:52:16.953721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 287/596] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:16.970062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:16.971034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:16.977523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.978014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.980616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:16.980616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:16.980616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:16.980987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.182909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.193923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.195846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:17.197067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-19f0dc21-fd33-47c7-a967-e59183198e63 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.232455 Aug 24 03:52:17.208069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 310/597] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:16 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:17.791036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:17.791726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:17.799392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.799902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.800359 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.801039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.801488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.801909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.815271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:17.817268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:17.828507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.829169 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.829765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:17.831010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:17.831847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:17.832740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.089321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.098595 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-70311d42-31bf-4b55-8fc9-983fe61bfc43 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.311317 Aug 24 03:52:18.099192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 288/598] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:17 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:18.104152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:18.104944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:18.111605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.112094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.112569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.113314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.113876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.114522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.116393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.125595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-36f82a29-3bd7-45e2-84a0-75a646ec5807 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.317746 Aug 24 03:52:18.126219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 311/599] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:17 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:18.222140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:18.222705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:18.229350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.230072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.230699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.237049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.237049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.237049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.352477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.361444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7cf28211-47fe-4e2c-b845-bc0d8014d276 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.260843 Aug 24 03:52:18.374186 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 289/600] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:18 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:18.419268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.428227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.429845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:18.431058 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6b9c1069-4a74-4033-99b5-da03faad0b50 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.213804 Aug 24 03:52:18.431634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 312/601] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:18 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:18.678517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:18.679338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:18.687016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.688813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.689771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.690689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:18.691315 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:18.691810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:18.856539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'services' on Instance uuid c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:19.120399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:19.121022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:19.128289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.128776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.129218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.129775 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cb1b582f-c51f-49c0-b8af-ae1a71e119a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24/os-volume_attachments/155b4a58-e6fa-4ba3-8243-68f16efd3d63" status: 202 len: 0 microversion: 2.1 time: 0.455266 Aug 24 03:52:19.129974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.130390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 290/602] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:52:18 2022] DELETE /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24/os-volume_attachments/155b4a58-e6fa-4ba3-8243-68f16efd3d63 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:52:19.130489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.130875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.148737 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:19.155030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:19.156608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.157135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.157590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.158315 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.158810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.159394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.408666 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.417813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4d820723-492e-44ac-af0f-e8541e79a19e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.301224 Aug 24 03:52:19.418438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 313/603] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:19 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:19.424321 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:19.424932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:19.431150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.431638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.432077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.432771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.433226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.433655 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.436019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.438252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:19.445991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bc855427-47e3-476b-aafa-b18e76afcdad tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.301218 Aug 24 03:52:19.446798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 291/604] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:19 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:19.463400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:19.463400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:19.463400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.463400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.463817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.464526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:19.464984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:19.465410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:19.653624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.658493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.662936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4476c2cc-1d97-48db-9d5a-30f0b4ae4baf tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.243306 Aug 24 03:52:19.663625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 314/605] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:19 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:19.667296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.668888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:19.670103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b12bc91b-9bf9-465d-868e-3f02d3cc204a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.219328 Aug 24 03:52:19.670791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 292/606] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:19 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:20.439756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:20.440371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:20.446980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.447462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.447907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.448636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.449130 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.449557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.472072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:20.472635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:20.479357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.479841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.480276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.480979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.481439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.481865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.692377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.703585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-197c9c92-d0fe-4a96-a10e-951d7bd60b5c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1710 microversion: 2.1 time: 0.267541 Aug 24 03:52:20.706870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.715068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-33c2028c-0ceb-4781-bbe9-238f4c837b88 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1313 microversion: 2.1 time: 0.247654 Aug 24 03:52:20.716067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 293/607] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:20 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:20.718637 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 315/608] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:20 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1710 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:20.722565 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:20.723231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:20.728418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:20.729157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:20.729809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.730399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.730896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.731677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.746209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.746209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.746462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.746462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.746462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.746462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:20.746849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:20.746849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:20.950105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.958759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.959451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-20847f6c-c070-4b8e-bfde-68476ed9c6bc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.241643 Aug 24 03:52:20.960138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 294/609] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:20 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:20.970308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.972365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:20.973923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b8c1ce29-894d-445c-a3c0-2f8c8fa89fe9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.253765 Aug 24 03:52:20.974760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 316/610] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:20 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:21.732188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.733112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.740362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.740861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.746174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.746174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.746174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.746174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.747659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.748338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.755078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.755567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.756005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.756701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.757156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.757596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.956804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:21.959613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:21.960333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:21.965412 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c991f394-be4c-4de6-b577-56576b4a534a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1714 microversion: 2.1 time: 0.237324 Aug 24 03:52:21.966200 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 295/611] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1714 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:21.967859 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b130b9c8-7e9c-4efc-b19f-635ad7e1eecd tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1498 microversion: 2.1 time: 0.224025 Aug 24 03:52:21.968844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 317/612] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:21.981247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.981868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:21.989553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.989695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.990144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.990881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:21.991326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:21.991784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:21.997713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:21.999280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:22.005836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.006522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.011538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.011538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.011887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.012343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.211698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:22.220232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:22.229266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:22.231007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:22.231417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-04823a10-2b4b-4ddf-bcb0-4b4d827aba39 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.254191 Aug 24 03:52:22.232132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 296/613] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:22.232401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7c2bc643-27e1-44ff-a196-b0cc4b390bf6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.239111 Aug 24 03:52:22.233743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 318/614] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:21 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:22.251582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-39927a7d-5b7f-4096-8e7e-d672dc41f86f req-1f962bd5-93d1-4349-88f0-c597b62d51ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069", "name": "network-vif-plugged", "status": "completed", "tag": "dcfe2060-ccc1-4d2c-8209-5005cab9521a"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:22.260861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-39927a7d-5b7f-4096-8e7e-d672dc41f86f req-1f962bd5-93d1-4349-88f0-c597b62d51ff service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:22.261413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-39927a7d-5b7f-4096-8e7e-d672dc41f86f req-1f962bd5-93d1-4349-88f0-c597b62d51ff service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:22.261844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-39927a7d-5b7f-4096-8e7e-d672dc41f86f req-1f962bd5-93d1-4349-88f0-c597b62d51ff service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:22.274004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-39927a7d-5b7f-4096-8e7e-d672dc41f86f req-1f962bd5-93d1-4349-88f0-c597b62d51ff service nova] Creating event network-vif-plugged:dcfe2060-ccc1-4d2c-8209-5005cab9521a for instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 on hv-cinder-85425 Aug 24 03:52:22.279023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-39927a7d-5b7f-4096-8e7e-d672dc41f86f req-1f962bd5-93d1-4349-88f0-c597b62d51ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045456 Aug 24 03:52:22.279607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 297/615] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:23.253109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:23.253767 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.257635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:23.258364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.260398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.260887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.261337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.262042 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.262529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.262959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.264899 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.265475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.265912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.266627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.267075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.267497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.470073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.473730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.478081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2d8806f6-050f-4edc-9147-b24b82b7e419 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.228876 Aug 24 03:52:23.478757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 319/616] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:23 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:23.482922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.484736 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:23.485921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b279c49c-c1ed-41e2-aa74-3cb66ee9692a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.233013 Aug 24 03:52:23.486498 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 298/617] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:23 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:23.938507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:23.939161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:23.945635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.946120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.946618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.947323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:23.947778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:23.948197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:23.977031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:52:24.432646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-acb58010-288d-4326-8b4e-27bd415513c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 204 len: 0 microversion: 2.1 time: 0.498959 Aug 24 03:52:24.433244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 320/618] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:23 2022] DELETE /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:52:24.441562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:24.442269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:24.449047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.449531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.449966 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.450822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.462625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.462625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.502992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:24.507063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:24.511299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.512167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.512685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.513463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.514570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.515104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.720741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:24.729194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-de367a97-3403-421f-bcc1-1d0ed770def6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1504 microversion: 2.1 time: 0.291379 Aug 24 03:52:24.729873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 299/619] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:24 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:24.739863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:24.741502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:24.748814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.748979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.749371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:24.750086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:24.750590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:24.751023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.032276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.042618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cec515b4-d28a-4e0f-a189-681802eb302d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.544972 Aug 24 03:52:25.043508 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 321/620] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:24 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:25.124290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.133100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.134625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.135784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7f3be31a-66aa-471b-9d8b-d5b8254a1eb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.404895 Aug 24 03:52:25.136359 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 300/621] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:24 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:25.751916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:25.752461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:25.759046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:25.759547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:25.759982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.760686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:25.761144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:25.761575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:25.893509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:25.901241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4cbbf0ae-5493-449c-b30a-6e76d83da034 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1504 microversion: 2.1 time: 0.153928 Aug 24 03:52:25.901805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 322/622] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:25 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.071470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:26.071470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:26.073927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.074438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.074868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.075554 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.076002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.076421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.160963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:26.160963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:26.166764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.167294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.168959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.168959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.168959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.169465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.225503 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.233995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f5d31771-4dae-4008-9581-7076e0ca377f tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.174131 Aug 24 03:52:26.235088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 301/623] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:26 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:26.312331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.320948 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.322536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:26.323635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8054cc49-ff41-461d-9b09-cfb3f2cfb09c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.168156 Aug 24 03:52:26.324192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 323/624] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:26 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:26.924655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:26.925295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:26.931439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.931992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.932374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:26.933057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:26.933501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:26.933923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.070918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.079554 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-09c3b810-2db6-4217-a8eb-d17914b356d3 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1504 microversion: 2.1 time: 0.159672 Aug 24 03:52:27.080542 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 302/625] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:26 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:27.255724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.257370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.264549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.265037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.265476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.266209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.266669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.267095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.348547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:27.349549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:27.355874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.362835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.363444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.364800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:27.364904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:27.365309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:27.420638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.428469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-61d8f5a4-73c9-4ff4-9f2c-416e0af083aa tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.176762 Aug 24 03:52:27.429052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 324/626] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:27.560455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.570226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.571777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:27.572973 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ebbc8557-57f7-47c4-9ba3-77096404976d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.228968 Aug 24 03:52:27.573526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 303/627] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:27 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:28.101254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.101865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.110138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.110652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.111101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.111802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.112253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.112686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.276844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.288111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5b2ea1ef-8a20-48a7-a401-368a50c33604 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1504 microversion: 2.1 time: 0.190879 Aug 24 03:52:28.288684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 325/628] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:28 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:28.451513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.452305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.460859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.461529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.466914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.466914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.466914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.466914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.597614 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.598439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.605670 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.606398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.607150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.609213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.610522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.611261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.635072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.643565 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-28b33826-2d4f-4160-b473-4d6efe275225 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.196660 Aug 24 03:52:28.650193 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 304/629] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:28 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:28.759264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.768862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.770413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:28.771597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-66f5d0d9-c922-42da-8e79-5c3efcc0a8f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.179003 Aug 24 03:52:28.772138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 326/630] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:28 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:28.791518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:28.792174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:28.799192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.799691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.800133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.800850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:28.801305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:28.801734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:28.830788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:52:29.179770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-8e84f1dc-ba00-4b90-8567-c117d5ff121d req-3ff884b9-3ec5-4a8e-a3d0-db82effbfe78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4d3788e-697f-4045-9fb4-05599b92c0ff", "name": "network-vif-deleted", "tag": "bbbf9c99-3582-402d-aa7c-12c62c616005"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:29.191150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8e84f1dc-ba00-4b90-8567-c117d5ff121d req-3ff884b9-3ec5-4a8e-a3d0-db82effbfe78 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.191883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8e84f1dc-ba00-4b90-8567-c117d5ff121d req-3ff884b9-3ec5-4a8e-a3d0-db82effbfe78 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.192476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8e84f1dc-ba00-4b90-8567-c117d5ff121d req-3ff884b9-3ec5-4a8e-a3d0-db82effbfe78 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.211733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-8e84f1dc-ba00-4b90-8567-c117d5ff121d req-3ff884b9-3ec5-4a8e-a3d0-db82effbfe78 service nova] Creating event network-vif-deleted:bbbf9c99-3582-402d-aa7c-12c62c616005 for instance f4d3788e-697f-4045-9fb4-05599b92c0ff on hv-cinder-85425 Aug 24 03:52:29.219337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-8e84f1dc-ba00-4b90-8567-c117d5ff121d req-3ff884b9-3ec5-4a8e-a3d0-db82effbfe78 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043010 Aug 24 03:52:29.225215 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 327/631] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:29.321842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.323556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.337779 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.338268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.338892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.339760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.340377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.340966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.354694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a884d9c3-c69d-4d95-a11e-638e0f519f0c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 204 len: 0 microversion: 2.1 time: 0.566744 Aug 24 03:52:29.355282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 305/632] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:28 2022] DELETE /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:52:29.371020 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.371728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.400014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.400510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.401371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.401859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.402492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.403138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.430553 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:29.440886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8edd34cf-2b8b-45cb-a7fb-e95ce5875888 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.123681 Aug 24 03:52:29.456132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 328/633] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:29.572344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2006359362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1056783115", "security_groups": [{"name": "tempest-secgroup-smoke-550765759"}], "block_device_mapping_v2": [{"uuid": "4bd5680c-7f8d-4be6-a64e-cfb640a0794e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8e8b02d-24a6-4dbc-a526-ca5dd9721bf6"}]}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:29.647119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:29.658989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ad47c489-51a1-4ea5-8db3-ceed2e7b32ff tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.298252 Aug 24 03:52:29.673330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 306/634] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:29.673330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.673330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.677878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.678409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.678844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.682538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.682538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.682538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.721400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] validate_networks() for [('e8e8b02d-24a6-4dbc-a526-ca5dd9721bf6', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:52:29.916158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:29.928701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2137037a-a20e-44c7-a0bd-763ccdc984b9 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.261829 Aug 24 03:52:29.929272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 307/635] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:29.939688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:29.948228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:29.956068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.956557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.957065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:29.957869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:29.958424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:29.958920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.189505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.198780 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.200208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.201631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ee5a57a6-5d46-432e-bff6-e7be22a26e47 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.271192 Aug 24 03:52:30.202382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 308/636] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:29 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:30.281563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:52:30.281563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:52:30.281563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:52:30.281563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:52:30.281563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:52:30.286745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.287219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.287666 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.288398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.288852 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.289277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.308043 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:52:30.312485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for user 71ff73cade8b42c7ae57be1e3ef0e028 and project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:52:30.372925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:52:30.375379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bd5680c-7f8d-4be6-a64e-cfb640a0794e',volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:52:30.463357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:30.463880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:30.471335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.471991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.472436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.473135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.473579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.474013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.550606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.559599 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-678b9a06-907d-4e3e-ad63-19e5fdc49634 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.100132 Aug 24 03:52:30.560935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 309/637] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:30 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:30.683636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:30.684426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:30.691224 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.691709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.692151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.692852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.693305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.693732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.841286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:30.850805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dedc2a53-0f87-4b83-850e-95746af918a5 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.171005 Aug 24 03:52:30.851391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 310/638] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:30 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:30.950095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:30.950735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:30.958047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.958553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.958986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.959955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:30.960631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:30.961056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:30.982103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:31.104059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:31.105589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.117147 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-34ff7f6f-3827-40ec-8990-399da728123d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.170901 Aug 24 03:52:31.117746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 311/639] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:30 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:31.230650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.231612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.243526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.244346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.244894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.245719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.246264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.246703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.254806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c95db83a-386d-4705-b985-e9d9597b62cf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.686467 Aug 24 03:52:31.255770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 329/640] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:52:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:52:31.271510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bcf77070-d5f6-4913-a112-54cfacf3260f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.276093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bcf77070-d5f6-4913-a112-54cfacf3260f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.365345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bcf77070-d5f6-4913-a112-54cfacf3260f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.373699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bcf77070-d5f6-4913-a112-54cfacf3260f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1095 microversion: 2.1 time: 0.110834 Aug 24 03:52:31.382593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 330/641] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1095 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:31.449684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.461131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.462664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.463947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b72f3eb3-2815-48f7-9999-163a3c7d9daa tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.238089 Aug 24 03:52:31.464737 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 312/642] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:31.581891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.582494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.588797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.589299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.589725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.590455 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.590923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.591353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.614468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:31.661461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:31.669550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6506d5f7-d586-431b-8db0-91a104c59674 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.091949 Aug 24 03:52:31.670499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 331/643] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:31.876770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:31.877869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:31.883886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.884371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.884857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:31.885849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:31.886013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:31.886464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.034768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.042873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bc0d1038-b7b1-4fea-9b79-4ff48596f001 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.170660 Aug 24 03:52:32.043865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 313/644] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:31 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:32.139322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.139952 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.146791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.147274 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.147705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.148399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.148845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.149267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.300201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.307166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6a582dc5-197a-447e-860d-f25e0dd7eb82 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.172187 Aug 24 03:52:32.307753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 332/645] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:32.396919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7061a8c1-23c7-4c4f-a011-c51580b2ad15 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.398139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7061a8c1-23c7-4c4f-a011-c51580b2ad15 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.465069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7061a8c1-23c7-4c4f-a011-c51580b2ad15 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.473073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7061a8c1-23c7-4c4f-a011-c51580b2ad15 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1095 microversion: 2.1 time: 0.080533 Aug 24 03:52:32.473740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 314/646] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:32.490236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.491091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.498098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.499000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.499633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.500414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.500914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.501327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.662001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.673224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.674789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.676023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8db79aa6-6fdb-47df-8c12-acbd114de5a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.189840 Aug 24 03:52:32.676773 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 333/647] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:32.691500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:32.692480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:32.698999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.703502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.703502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.703502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:32.703502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:32.703905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:32.783349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:32.791710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8acdca35-e0b3-4d01-9628-3540815b29c0 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.104341 Aug 24 03:52:32.792307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 315/648] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:32 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.065709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.066278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.072653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.073207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.073662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.074392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.074845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.075340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.221765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.229879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-becdae5e-498c-4e18-8c62-37b50f370c18 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.168148 Aug 24 03:52:33.230489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 334/649] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.330036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.330650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.334031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:33.337500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.337988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.338461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.339166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.339622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.340048 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.480329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.489730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cb2f76a6-3620-44e5-a935-8afe7f15e6f7 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.164473 Aug 24 03:52:33.490350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 316/650] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.495606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.497061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.509305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.509888 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.510438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.511144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.511624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.512046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.580969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.589009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-468da762-3411-49d9-b39c-78fc46b5d6fb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.097075 Aug 24 03:52:33.589935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 335/651] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:33.699674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.700269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.706773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.707260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.707691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.708382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.708824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.709239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.815531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:33.823521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:33.833304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.833706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.834954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.835853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:33.836307 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:33.836733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:33.878272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.895773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.900998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.906050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-60c82672-97d3-4348-88c6-b31df7b564bc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.208672 Aug 24 03:52:33.907377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 317/652] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:33.933237 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:33.942431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-036ea89a-3ce1-444a-be60-6fe9454d9526 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.132276 Aug 24 03:52:33.943013 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 336/653] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:33 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:34.252757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.254006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.260822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.261387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.261897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.262722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.263250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.264463 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.409374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.418423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-38250cd5-797e-4979-a3c8-f0dae4e75680 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.170568 Aug 24 03:52:34.427401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 318/654] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:34.511851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.513263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.520768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.521355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.521813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.522568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.523033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.523468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.611507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.612129 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.618919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.619741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.620351 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.621225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.621837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.622446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.708667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.711416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:34.715807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cb121733-1c4f-4ac8-8b3a-21d30d277088 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.109329 Aug 24 03:52:34.717748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 319/655] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:34.722827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e6f32b04-71fb-4b3c-8918-6ef60901e251 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.214842 Aug 24 03:52:34.723579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 337/656] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:34.931433 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.932155 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.938946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.939518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.940020 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.940719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.941181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.941577 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.965348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:34.966080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:34.974433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.975022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.975539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:34.977301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:34.977943 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:34.978461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.065268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.077142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-55b54656-586e-431d-a147-266e6c6b5882 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.115953 Aug 24 03:52:35.078460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 338/657] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:35.135065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.145158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.147479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.149072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-039efb31-5017-4834-bfcf-d09a61a793f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.221606 Aug 24 03:52:35.149979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 320/658] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:34 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:35.441682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.442426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.448740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.449312 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.449841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.450682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.451823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.452375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.593994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.599117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3a712c6c-8543-4e05-9bc3-f30bc7d759a1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.161906 Aug 24 03:52:35.599695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 339/659] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:35.738606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.739286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.745151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:35.745854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:35.746716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.747240 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.750591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.750591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.750591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.750591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.755710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.756210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.756818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.757715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:35.758246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:35.758701 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:35.831066 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.839416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e562c0a4-46c0-449e-8238-7371c8627025 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.105614 Aug 24 03:52:35.846843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 321/660] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:35.927428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:35.938322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6973a4d6-cef7-4356-a532-21cbc9238b7a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.196973 Aug 24 03:52:35.938977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 340/661] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:35 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.098674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.099400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.105829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.106341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.106774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.108387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.108884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.109612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.173793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.174442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.179226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.183828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.184338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.184789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.185607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.186080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.186556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.196966 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7524c14f-b56e-47cd-a18b-b8519f3a4625 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.101865 Aug 24 03:52:36.198567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 322/662] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.343812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.352948 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.354410 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.355588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6be54763-800f-4e5f-ae53-8d4cfde84b2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.186599 Aug 24 03:52:36.356319 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 341/663] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:36.620892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.621407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.629312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.629805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.630292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.631038 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.631520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.631970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.789733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.799516 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b8aae99f-f8fe-4ecd-a5f7-f6ff19c1b458 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.182270 Aug 24 03:52:36.800237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 323/664] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.862483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.863126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.869712 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.870242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.870688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.871441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.871851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.872287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.938696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:36.947916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5d7e7c5d-09bd-45d1-b9d0-1f4470200abf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.090255 Aug 24 03:52:36.958858 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 342/665] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:36.964551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:36.966138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:36.973602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.974097 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.974571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:36.975397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:36.975850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:36.976273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.142673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.152808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-95e676aa-80ea-4e72-99da-b7b5abe768a3 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.192978 Aug 24 03:52:37.154004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 324/666] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:36 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:37.221657 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.226138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.239068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.239549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.240203 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.240953 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.241406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.241831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.324538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.333406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d37e9c0d-36e2-4ae5-b118-dee717ee575f tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.116568 Aug 24 03:52:37.334066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 343/667] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:37.381657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.382582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.389627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.390140 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.390684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.391401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.392072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.392501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.548844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.558219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.559769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:37.561235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4bf20f41-b199-431b-95c4-b6a3e6913cfc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.184167 Aug 24 03:52:37.562002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 325/668] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:37.824826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.825316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.833923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.834464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.834907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.836450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.836603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.837228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.973151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:37.973752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:37.981661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.982214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.982913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.983635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:37.984353 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:37.984785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:37.994088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.004823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-87258635-29f9-47ba-b8a4-a98109479a3d tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.184104 Aug 24 03:52:38.005525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 344/669] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:38.058556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.067318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e6505db6-32c9-4630-b0b8-e4754ef6b0b2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.098182 Aug 24 03:52:38.067908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 326/670] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:37 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:38.175970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.176841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.183885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.184515 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.185009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.186045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.186851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.187389 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.344018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.358067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d642ef23-42e7-42c5-9b27-6422bc985615 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.185380 Aug 24 03:52:38.372507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 345/671] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:38.372731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.372731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.373602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.374480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.375227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.376454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.377408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.378173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.465384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.477511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-349d9209-b7fb-47ae-9a0b-ee13da3acf1e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.122233 Aug 24 03:52:38.478555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 327/672] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:38.585878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:38.586546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:38.593642 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.594209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.594662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.595378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:38.595839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:38.596266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:38.747401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.756873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.758426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:38.759785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-816aa225-b8e9-4d47-b469-bdce2c7fe7f6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.178320 Aug 24 03:52:38.760144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 346/673] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:38 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:39.028545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.030792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.037615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.038102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.038578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.039275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.039721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.040157 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.088984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.089599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.097874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.097874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.098254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.098925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.099380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.099809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.188182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.195919 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5a244712-4556-4a59-82a2-bbb545108c32 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.110758 Aug 24 03:52:39.196496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 347/674] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:39.220993 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.229002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-11da90e5-5235-4d69-a0ff-5270c62d00bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.204550 Aug 24 03:52:39.229540 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 328/675] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:39.380627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.381246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.387768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.388252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.388904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.389698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.390175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.390609 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.394844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:39.499999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.500771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.508540 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.509153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.509685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.510543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.511097 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.511583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.522448 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:39.540683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.549119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e00453b3-1ac1-4d48-8720-aa9e7ccbb685 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.172503 Aug 24 03:52:39.549706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 348/676] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:39.589900 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.599110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-33d4d603-6adf-4c08-aa97-b122f26fb9f6 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.103291 Aug 24 03:52:39.599690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 329/677] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:39.784867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:39.785672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:39.791871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.792361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.792798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.793503 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:39.793956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:39.794408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:39.941856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.952309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.953851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:39.955465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-591327e9-282f-485b-be80-6d42d0448175 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.174697 Aug 24 03:52:39.956150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 349/678] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:39 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:40.218412 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.219052 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.225585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.226354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.226791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.227501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.227952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.228373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.252945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.253764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.261970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.262498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.262937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.264330 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.264741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.265543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.297198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.299842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:40.305777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a5cad84d-4d84-454a-b131-2fd0be46a81b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.092874 Aug 24 03:52:40.306406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 330/679] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:40.414800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.423229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d3ca9e85-ae39-4374-bda5-45262490802f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.174924 Aug 24 03:52:40.423932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 350/680] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:40.571650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.572486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.579581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.580363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.581469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.581469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.581943 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.582409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.623906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.624778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.632209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.632874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.634251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.635324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.635324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.635539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.719665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.729619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7e84a935-ce8f-46b4-a6b1-573a8a5e83f7 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.112210 Aug 24 03:52:40.730686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 351/681] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:40.757256 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:40.768429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ce74801a-6b59-468b-983d-855bddbc595a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.201999 Aug 24 03:52:40.769054 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 331/682] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:40.981386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:40.982445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:40.988923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.989405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.989841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:40.990727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:40.991207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:40.991649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.138220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.147867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.149393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.150619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4a676c82-ed33-41d8-afcc-557afacf43be tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.174173 Aug 24 03:52:41.151378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 352/683] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:40 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:41.328246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.328805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.335632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.336129 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.336569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.337288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.337752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.338198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.402714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.411470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-17cbb7bf-27cb-484f-bf28-d581928dc864 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.087806 Aug 24 03:52:41.412241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 332/684] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:41.445065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.445730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.448107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=8 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:41.453794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.454346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.454819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.455620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.456078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.456543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.597404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.606829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e3409618-271e-41c2-9b37-390b14e0d35f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.165792 Aug 24 03:52:41.609664 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 353/685] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:41.753501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.754124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.760682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.761202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.761647 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.762392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.762847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.763810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.789445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:41.790084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:41.796975 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.797511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.797992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.798749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:41.799211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:41.799643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:41.844767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.853026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-28b96e77-3db7-4341-97de-9fad7e9bbd68 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.103547 Aug 24 03:52:41.858815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 333/686] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:41.948510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:41.957397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e8bbc89a-3ff0-422c-becd-d40bd07feb65 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.171736 Aug 24 03:52:41.957973 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 354/687] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:41 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:42.174074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.174615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.180949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.181428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.181856 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.182589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.183044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.183458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.328346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.337591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.339140 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.340310 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-15be247f-1724-46da-a603-fa95ef5e44e2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.170600 Aug 24 03:52:42.341545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 334/688] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:42.433250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.433792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.441175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.441677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.442118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.442876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.443367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.443796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.511065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.519727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-48d6dc19-5606-45b2-8d35-8e13b3717fc3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.090522 Aug 24 03:52:42.520323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 355/689] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:42.629816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.630537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.632544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:42.637406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.637960 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.638478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.641490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.641490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.641490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.779922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.787988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-afadd7ed-593b-457c-ae78-d7a2ce48f7f0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.162155 Aug 24 03:52:42.788586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 335/690] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:42.877640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.878281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.884477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.884966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.885406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.886173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.886630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.887059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.953481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:42.961367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-855d91ac-1efd-46cb-a081-2165eec2902c tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1462 microversion: 2.1 time: 0.087855 Aug 24 03:52:42.961952 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 356/691] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:42.978652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:42.979181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:42.986203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.986695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.987123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:42.987819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:42.988270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:42.988692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.130763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.140268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-63d91789-3190-4483-8c0f-77d2c19372da tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1315 microversion: 2.1 time: 0.165425 Aug 24 03:52:43.140937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 336/692] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:42 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:43.365208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.365829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.372282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.373469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.373912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.374685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.375142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.375566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.521098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.532187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.533777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.535002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-92600c52-314e-4d7e-85d6-9e78a43b2479 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.173822 Aug 24 03:52:43.539019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 357/693] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:43.554125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.555616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.563809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.567897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.567897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.567897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.567897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.568311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.633731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.641968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b22be832-60dd-42b6-93b3-ae36c426c14d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.094226 Aug 24 03:52:43.642579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 337/694] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:43.809273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.809921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.816841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.817379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.817815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.818542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.818989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.819420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.958497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:43.967039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8596db75-1d4c-4546-8370-13aabd8e87ad tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.161218 Aug 24 03:52:43.967790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 358/695] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:43.983377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:43.984273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:43.990393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.990887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.991328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:43.992027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:43.992480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:43.992913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.056617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.064864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cbe5218f-952f-4b4d-b8c1-0f0ab928823a tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1298 microversion: 2.1 time: 0.085648 Aug 24 03:52:44.065258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 338/696] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:43 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.161676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.162234 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.168347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.168832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.169266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.169978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.170456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.170916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.303576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.312895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ad2f3dbd-6de2-4ebd-8343-d95bae9f352c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1465 microversion: 2.1 time: 0.155165 Aug 24 03:52:44.313504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 359/697] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.359916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.360407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.367337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.367824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.368255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.368942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.369394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.369814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.396220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:52:44.562631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.563270 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.569408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.569897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.570373 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.571067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.571526 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.571953 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.709449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e6fc0373-99a9-4104-8687-f7f8182dafb2 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 204 len: 0 microversion: 2.1 time: 0.353314 Aug 24 03:52:44.710318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 339/698] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:52:44 2022] DELETE /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:52:44.718894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.720054 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.723904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.729979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.730813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.731520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.732714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.733505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.734530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.739467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.748199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.748199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-28dc0efa-610b-42cf-bda3-4deb1cdd2666 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.185482 Aug 24 03:52:44.748199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 360/699] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:44.753522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.754571 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.765128 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.765942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.766724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.767869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.768626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.769451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.818574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.828581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f5626e79-efeb-4d07-a5a3-3bdfacc5c5bf tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.116346 Aug 24 03:52:44.829199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 340/700] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.914396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:44.922662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8f569af8-18fa-493c-8d27-8866241adf88 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.176943 Aug 24 03:52:44.923396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 361/701] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:44.988907 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:44.989440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:44.995555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.996043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.996483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:44.997224 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:44.997757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:44.998223 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.086411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.087030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.093995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.094522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.094961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.095672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.096128 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.096559 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.145328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.153338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f6084b3b-484c-46cb-9c97-09d62746d296 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.168564 Aug 24 03:52:45.154582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 341/702] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:44 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:45.162853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.170877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-85783b42-eb89-44f3-b560-3ac6288ddf04 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1298 microversion: 2.1 time: 0.088340 Aug 24 03:52:45.171456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 362/703] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:45.770001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.770572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.777183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.777665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.778099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.778893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.779363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.779799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.849111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.849864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.856602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.861225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.861225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.861225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.861225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.861876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.936358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.944839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cea468cf-45c7-47e5-9f77-b3c556a2f9a7 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.099758 Aug 24 03:52:45.947675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 363/704] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:45.952541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:45.953144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:45.956420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.959874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.960032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.960427 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.961121 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:45.961602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:45.962035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:45.965234 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.967792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:45.969036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8c74a0c0-c971-4720-8190-81520165f2b3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.203078 Aug 24 03:52:45.969612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 342/705] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:46.101007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.104476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:46.110292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-65dea9d6-94d6-4d97-bcbb-ea3e951dbdac tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.161566 Aug 24 03:52:46.110879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 364/706] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:45 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:46.174832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.175442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:46.181564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.182047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.182506 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.183205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.183653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.184079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.192101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.192709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:46.199036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.199527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.199966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.201121 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.201590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.202055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.289525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.297800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9bd31325-d9dc-4f33-8f91-1cd586984f2d tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1298 microversion: 2.1 time: 0.109871 Aug 24 03:52:46.298328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 365/707] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:46.351465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:46.360306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-df08715c-b11d-45c3-bfc2-d14e5ee27b57 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.189462 Aug 24 03:52:46.360576 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 343/708] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:46.968229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.968831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:46.974909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.975429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.975872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.976611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:46.977069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:46.977501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:46.996568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:46.997291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.004188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.004656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.005091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.005782 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.006260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.007295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.011129 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:47.047392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.056019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b4e4c2ae-1e29-4231-afc5-53fd54b74df1 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1145 microversion: 2.1 time: 0.092414 Aug 24 03:52:47.056932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 366/709] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:47.131497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.132111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.138219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.138723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.139177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.139871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.140325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.140749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.154465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.163905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.165394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.166763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8337f77f-274c-447a-a62f-eed2c43fafc6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.174695 Aug 24 03:52:47.174248 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 344/710] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:46 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:52:47.303459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.303459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-31ed5b48-0951-4d6b-9da8-4f7e14ff061c tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.169961 Aug 24 03:52:47.303459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 367/711] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:47.319681 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.320293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.326686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.327167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.327609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.328380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.328968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.329450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.361529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.362012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.362481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.362933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lazy-loading 'fault' on Instance uuid f4d3788e-697f-4045-9fb4-05599b92c0ff {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:47.380099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:47.380709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:47.386891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.387370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.387803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.388882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:47.389377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:47.389802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:47.414394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.426028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b3d2645f-bf90-4adf-9463-4379c90f8c79 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1303 microversion: 2.1 time: 0.108968 Aug 24 03:52:47.426028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 345/712] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:47.549108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:47.573670 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5ed65105-9fed-469a-a752-c0e90b9f9388 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.197161 Aug 24 03:52:47.574546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 368/713] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:47 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:48.079067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.079685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.086342 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.086820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.087252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.087944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.088389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.088827 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.159793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.167986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aae3e758-0285-4da7-9c6f-bacdfcba76d6 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1137 microversion: 2.1 time: 0.093914 Aug 24 03:52:48.168741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 346/714] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:48.191035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.191640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.201978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.201978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.201978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.201978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.202749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.202749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.321347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.321971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.328948 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.329493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.329882 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.330624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.331079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.331509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.341151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.351220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.352837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.354039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-435ad6e1-1027-42f3-af8c-700ce8260e51 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.166913 Aug 24 03:52:48.354691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 369/715] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:48.449794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.449794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.453956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.454483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.454922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.455632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.456438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.456544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.479745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.488053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a7cf5487-ca8a-487d-97e5-3dd60b9e0599 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.170543 Aug 24 03:52:48.488634 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 347/716] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:48.489725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.490263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.490698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.491144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lazy-loading 'fault' on Instance uuid f4d3788e-697f-4045-9fb4-05599b92c0ff {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:48.534273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.541868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b52c0e9f-a9e9-441a-b0e3-67b2786f1b0e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1303 microversion: 2.1 time: 0.098961 Aug 24 03:52:48.542575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 370/717] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:48.597862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:48.598499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:48.604595 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.605080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.605611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.606455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:48.607425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:48.608148 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:48.748820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:48.757089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-54144c73-716b-4bcb-872a-ac6541b18b43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.163171 Aug 24 03:52:48.757661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 348/718] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:48 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.189489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.190096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.196595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.197178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.197513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.198345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.198834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.199264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.264146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.271933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a35be3c3-cb2d-4811-b206-65f3f3c784f3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1137 microversion: 2.1 time: 0.086368 Aug 24 03:52:49.272499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 371/719] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:49.377822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.378447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.385080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.385566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.386010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.386760 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.387216 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.387638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.520198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.520823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.527025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.527510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.527992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.536678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.536678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.536678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.537161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.541161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.543032 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.543897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2f741a13-e37f-4a23-b105-c6a397acba7f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.170053 Aug 24 03:52:49.544583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 349/720] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:49.563535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.564163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.571312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.571852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.572496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.573068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.573525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.574200 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.611771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.612253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.612687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.613148 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lazy-loading 'fault' on Instance uuid f4d3788e-697f-4045-9fb4-05599b92c0ff {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:49.665868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.673859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-229a5fee-06af-48cf-9b72-b283d532c061 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1303 microversion: 2.1 time: 0.114234 Aug 24 03:52:49.674472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 350/721] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:49.701178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.709654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2363ceff-36ea-47ce-8272-1d38b7747043 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.204404 Aug 24 03:52:49.710174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 372/722] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:49.779249 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:49.779858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:49.785965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.786480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.786923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.787649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:49.788101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:49.788526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:49.932842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:49.941306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-add70b83-2e3d-4937-8710-0611d503af43 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.165932 Aug 24 03:52:49.949215 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 351/723] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:49 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.126987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-a5d3fa74-8286-46be-952c-12d8357b4208 req-3c41f9c3-e011-4488-b2ed-d70dde7926ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ca1d53-be5a-4c9d-8891-0b2735dd8b24", "name": "network-vif-unplugged", "status": "completed", "tag": "4342b9d5-2129-4d9b-83db-ff7d31afd4e2"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:50.136894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a5d3fa74-8286-46be-952c-12d8357b4208 req-3c41f9c3-e011-4488-b2ed-d70dde7926ed service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.137383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a5d3fa74-8286-46be-952c-12d8357b4208 req-3c41f9c3-e011-4488-b2ed-d70dde7926ed service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.137819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a5d3fa74-8286-46be-952c-12d8357b4208 req-3c41f9c3-e011-4488-b2ed-d70dde7926ed service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.154751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-a5d3fa74-8286-46be-952c-12d8357b4208 req-3c41f9c3-e011-4488-b2ed-d70dde7926ed service nova] Creating event network-vif-unplugged:4342b9d5-2129-4d9b-83db-ff7d31afd4e2 for instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 on hv-cinder-85425 Aug 24 03:52:50.160078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-a5d3fa74-8286-46be-952c-12d8357b4208 req-3c41f9c3-e011-4488-b2ed-d70dde7926ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038619 Aug 24 03:52:50.160725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 373/724] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:50.293300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.293914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.300710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.304112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.304112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.304112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.304112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.304559 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.366544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.375117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a1b71557-1134-4191-bed9-0a0aa597e62e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1137 microversion: 2.1 time: 0.085692 Aug 24 03:52:50.375689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 352/725] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.568554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.569368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.575576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.576077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.576521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.577227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.577690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.578115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.696080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.696677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.703236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.703717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.704146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.704838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.705286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.705703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.725426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.734862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.736456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.737707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5de6cd71-2dac-4651-85c0-b4183bef88ee tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.174021 Aug 24 03:52:50.738573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 374/726] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:50.742848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.743275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.743388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.743746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.744021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.744186 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lazy-loading 'fault' on Instance uuid f4d3788e-697f-4045-9fb4-05599b92c0ff {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:50.750335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.750923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.751600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.752376 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.752899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.753536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.788275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.797477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-273dfe78-decd-48ae-b664-2a77e4c7881e tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1303 microversion: 2.1 time: 0.105245 Aug 24 03:52:50.798051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 353/727] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:50.897076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:50.905135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8ca16e8b-27a2-45ce-b72c-64d31a720a86 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.165453 Aug 24 03:52:50.905713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 375/728] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:50.962909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:50.963555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:50.970458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.970939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.971369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:50.972059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:50.972500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:50.972915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.117334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.125953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-785e771a-2412-4132-ab09-cdfa868d1821 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.166859 Aug 24 03:52:51.126562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 354/729] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:50 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:51.395804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.396408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.402605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.403086 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.404004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.404714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.405275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.405698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.470314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.478476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7062fd4b-a449-47cd-9b93-6f0db7ca88b5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1193 microversion: 2.1 time: 0.086422 Aug 24 03:52:51.479052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 376/730] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:51.761242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.761786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.768387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.768869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.769305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.770004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.770483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.770946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.819727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.820339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.822858 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:51.828047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.828537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.829025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.829691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.830142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.834292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.866119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.866639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.867256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.867714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lazy-loading 'fault' on Instance uuid f4d3788e-697f-4045-9fb4-05599b92c0ff {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:51.933465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae04cdfc35964cf58502cefd1cc912e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf3b9526fc541048f921613ded8ef2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.944738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-56c9dc3e-957d-4e7c-8741-5e9aab0fc380 tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 200 len: 1303 microversion: 2.1 time: 0.127421 Aug 24 03:52:51.944738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 377/731] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:51.948618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:51.949224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:51.955596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.956145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.956663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.958114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:51.958114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:51.958371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:51.975916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.987034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.988597 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:51.990259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2f197a74-83ae-407e-bb2f-f68a79a20e6d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.233113 Aug 24 03:52:51.991188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 355/732] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:52.099350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.107874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-20200506-cf08-495f-b959-a088a7d3cedc tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1471 microversion: 2.1 time: 0.162819 Aug 24 03:52:52.109660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 378/733] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:51 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:52.147263 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.147914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.154049 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.154556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.155549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.156262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.156719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.157152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.294887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.304012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1e47053b-8d4a-45dd-ad4f-a1ae01b6e385 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1514 microversion: 2.1 time: 0.160562 Aug 24 03:52:52.304596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 356/734] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:52.441238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-62c8c1e0-20a5-40b1-906f-45386d51ae7d req-f1994c2d-b8bb-42d2-8107-1d2fbb0b6da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069", "name": "network-vif-deleted", "tag": "dcfe2060-ccc1-4d2c-8209-5005cab9521a"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:52.454847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-62c8c1e0-20a5-40b1-906f-45386d51ae7d req-f1994c2d-b8bb-42d2-8107-1d2fbb0b6da5 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.455810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-62c8c1e0-20a5-40b1-906f-45386d51ae7d req-f1994c2d-b8bb-42d2-8107-1d2fbb0b6da5 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.456737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-62c8c1e0-20a5-40b1-906f-45386d51ae7d req-f1994c2d-b8bb-42d2-8107-1d2fbb0b6da5 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.481761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-62c8c1e0-20a5-40b1-906f-45386d51ae7d req-f1994c2d-b8bb-42d2-8107-1d2fbb0b6da5 service nova] Creating event network-vif-deleted:dcfe2060-ccc1-4d2c-8209-5005cab9521a for instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 on hv-cinder-85425 Aug 24 03:52:52.491880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-62c8c1e0-20a5-40b1-906f-45386d51ae7d req-f1994c2d-b8bb-42d2-8107-1d2fbb0b6da5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055154 Aug 24 03:52:52.493669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 379/735] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:52.501015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.501622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.510508 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.511136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.511849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.512752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.513309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.513871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.587926 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:52.596573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-99fb8234-81d7-4c6b-ab54-23826a666d8d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1193 microversion: 2.1 time: 0.099492 Aug 24 03:52:52.597150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 357/736] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:52.966490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:52.967183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] [instance: f4d3788e-697f-4045-9fb4-05599b92c0ff] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:52.973758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.974316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.974902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.975517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:52.975968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:52.976386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:52.992544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] HTTP exception thrown: Instance f4d3788e-697f-4045-9fb4-05599b92c0ff could not be found. Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Request method failure captured: Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff HTTP/1.1 Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaAWLQVhZ-h_M3dPPe3Ya6Mxr9mGf6Pm1k_OTmSNcT9JvxgSSiRK3jgI88Qn31lQwi-2_TIyRkOZDJF7Lh7japs61duBcAU8ZfLCb6810bthktwqUClgORGpnTVLJp11iDgGYSKGtDzwbqYZEpY6yPBQ9doCrIoDtWUWFPJFJh5_Aw8 Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 3cf3b9526fc541048f921613ded8ef2d Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesActionsTest-1045565331 Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:52:52.994245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3cf3b9526fc541048f921613ded8ef2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesActionsTest-1045565331 Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 3cf3b9526fc541048f921613ded8ef2d Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesActionsTest-1045565331 Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesActionsTest-1045565331-project Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: ae04cdfc35964cf58502cefd1cc912e9 Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesActionsTest-1045565331-project Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance f4d3788e-697f-4045-9fb4-05599b92c0ff could not be found. Aug 24 03:52:52.995793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'f4d3788e-697f-4045-9fb4-05599b92c0ff'} Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d3788e-697f-4045-9fb4-05599b92c0ff could not be found. Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:52.996564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d3788e-697f-4045-9fb4-05599b92c0ff could not be found. Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d3788e-697f-4045-9fb4-05599b92c0ff could not be found. Aug 24 03:52:52.997922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:53.001107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] Returning 404 to user: Instance f4d3788e-697f-4045-9fb4-05599b92c0ff could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:53.001107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5960a91d-f712-4491-a143-5a691807f6cb tempest-VolumesActionsTest-1045565331 tempest-VolumesActionsTest-1045565331-project] 10.222.0.65 "GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff" status: 404 len: 111 microversion: 2.1 time: 0.033988 Aug 24 03:52:53.001107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 380/737] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:52 2022] GET /compute/v2.1/servers/f4d3788e-697f-4045-9fb4-05599b92c0ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:53.018373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.018977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.025957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.026493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.027198 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.027939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.028600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.029288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.131233 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.131935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.138719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.139171 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.139706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.140522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.140984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.141417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.399167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.413483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bb56ac08-ff80-4ff1-86a4-6384dc5eb64a tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1300 microversion: 2.1 time: 0.285486 Aug 24 03:52:53.414258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 381/738] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1300 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:53.434199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.435278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.444760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.445576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.446728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.447659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.448284 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.449030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.520840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.531838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.533358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.534674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6f261d2f-460b-4a8e-96ab-fc8121c01993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.524457 Aug 24 03:52:53.538112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.541655 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:53.546383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-505e52b3-1b7a-4548-8998-d13e0b535abc tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1472 microversion: 2.1 time: 0.119379 Aug 24 03:52:53.548086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 358/739] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:53.548204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 382/740] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1472 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:53.617135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:53.617886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:53.624632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.625156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.625584 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.626331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:53.626794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:53.627258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:53.695001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:53.698625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:53.715380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-86addcca-1d27-4b60-a0e6-1f72adf434dc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1211 microversion: 2.1 time: 0.091134 Aug 24 03:52:53.715380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 359/741] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:53 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.437668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.439016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.448113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.448714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.449159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.449878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.450370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.450806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.488504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.489214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.489659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.490130 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lazy-loading 'fault' on Instance uuid e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:54.520536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-78033383-2511-43c7-a4cc-eb64038c9541 req-ef3363f6-7a03-4293-a7a8-2689f11e8006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ca1d53-be5a-4c9d-8891-0b2735dd8b24", "name": "network-vif-deleted", "tag": "4342b9d5-2129-4d9b-83db-ff7d31afd4e2"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:54.539768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:54.543395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-78033383-2511-43c7-a4cc-eb64038c9541 req-ef3363f6-7a03-4293-a7a8-2689f11e8006 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.544068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-78033383-2511-43c7-a4cc-eb64038c9541 req-ef3363f6-7a03-4293-a7a8-2689f11e8006 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.544839 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-78033383-2511-43c7-a4cc-eb64038c9541 req-ef3363f6-7a03-4293-a7a8-2689f11e8006 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.550108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2791e367943d4e1eaddd0f0f930ad8c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d4ab58d984c78a68a69f393118927', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.559005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b485b703-1d0d-4a9f-a1c4-5031958156f4 tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 200 len: 1305 microversion: 2.1 time: 0.126632 Aug 24 03:52:54.559621 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 383/742] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.584686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-78033383-2511-43c7-a4cc-eb64038c9541 req-ef3363f6-7a03-4293-a7a8-2689f11e8006 service nova] Creating event network-vif-deleted:4342b9d5-2129-4d9b-83db-ff7d31afd4e2 for instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 on hv-cinder-85425 Aug 24 03:52:54.585222 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.586343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.592096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-78033383-2511-43c7-a4cc-eb64038c9541 req-ef3363f6-7a03-4293-a7a8-2689f11e8006 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077594 Aug 24 03:52:54.593575 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 360/743] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:52:54.595237 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.596325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.597482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.598992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.599878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.600840 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.601958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.602903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.610842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.611456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.612034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.612866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.613424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.613959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.647721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.648473 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.648915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.649696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'fault' on Instance uuid c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:54.709459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.721874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d20130e2-cfb9-4f12-baba-153d9234ae64 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1309 microversion: 2.1 time: 0.126372 Aug 24 03:52:54.722501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 361/744] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:54.735074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:54.735774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:54.742049 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.742853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.743488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.744338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:54.744999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:54.745580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:54.788046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.797727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.800765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.816027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0c5c198d-d700-43d7-a1a0-84ba1cbfc737 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.233692 Aug 24 03:52:54.816027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 384/745] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:54.899975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:54.908426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-514c9496-642f-4b9d-b998-b52a255585c2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1278 microversion: 2.1 time: 0.177672 Aug 24 03:52:54.909004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 362/746] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:54 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:55.582995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.583714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] [instance: e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.590385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.590872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.591300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.591993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.593469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.593469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.608509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] HTTP exception thrown: Instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 could not be found. Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Request method failure captured: Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 HTTP/1.1 Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaBSGrogQjN86n7PGe1ey6xUK0jr7V3fOuMFXuG39ob_Xh6iTwL1OoYBzERIf4pTnk6WxU1en0eGZ9drUzJvVVldq4QPUTff8c2WabEBtwCGmm5t6avVSPWdAnuqh6uwXYf6jTY7RBsXzYUxWKxoAT9eV8juBhZdkS77zl2t8eB3sQk Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 618d4ab58d984c78a68a69f393118927 Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesNegativeTest-473259588 Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:52:55.611798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/618d4ab58d984c78a68a69f393118927"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/618d4ab58d984c78a68a69f393118927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/618d4ab58d984c78a68a69f393118927"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_618d4ab58d984c78a68a69f393118927"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesNegativeTest-473259588 Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 618d4ab58d984c78a68a69f393118927 Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesNegativeTest-473259588 Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesNegativeTest-473259588-project Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 2791e367943d4e1eaddd0f0f930ad8c1 Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesNegativeTest-473259588-project Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 could not be found. Aug 24 03:52:55.613352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069'} Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 could not be found. Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:52:55.614412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 could not be found. Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 could not be found. Aug 24 03:52:55.616182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:52:55.617260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] Returning 404 to user: Instance e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:52:55.617260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-11f549f3-0ce6-4334-ab82-c8876f61ef3d tempest-VolumesNegativeTest-473259588 tempest-VolumesNegativeTest-473259588-project] 10.222.0.65 "GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069" status: 404 len: 111 microversion: 2.1 time: 0.033307 Aug 24 03:52:55.617260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 385/747] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/e5d5cb6e-2cf5-4bc8-bd2e-d2d115a51069 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:52:55.743710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.747743 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.751751 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.752230 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.752661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.753352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.753795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.754266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.786848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.787334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.787816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.788314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'fault' on Instance uuid c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:55.833109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:55.838196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.838916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.845087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.845603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.846219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.846858 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.847334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.847787 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.849731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dbb746d6-949a-4c86-978e-4afb2a657daa tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1309 microversion: 2.1 time: 0.104105 Aug 24 03:52:55.850404 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 363/748] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:55.928898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:55.929605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:55.935511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.936521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.936961 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:55.937668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:55.938328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:55.938759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.035778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.045080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.053908 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.055282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3210c950-f2a3-4b8c-aa33-9497e0045964 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.221074 Aug 24 03:52:56.063084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 386/749] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:56.115755 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.124090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-213c82c4-12a0-4e0b-be60-5a249aa979da tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1278 microversion: 2.1 time: 0.198486 Aug 24 03:52:56.124677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 364/750] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:55 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:56.611241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-18efb4ee-db79-4191-800a-21f436d3f4f9 req-bb9b00cc-8f75-4f94-9603-b334166bfd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ca0e0-691f-45a3-a98a-8ddfda13473d", "tag": "3f848c01-a648-40ce-965b-af3528a5a06c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:52:56.621993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-18efb4ee-db79-4191-800a-21f436d3f4f9 req-bb9b00cc-8f75-4f94-9603-b334166bfd8c service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.622514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-18efb4ee-db79-4191-800a-21f436d3f4f9 req-bb9b00cc-8f75-4f94-9603-b334166bfd8c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.622946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-18efb4ee-db79-4191-800a-21f436d3f4f9 req-bb9b00cc-8f75-4f94-9603-b334166bfd8c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.635188 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-18efb4ee-db79-4191-800a-21f436d3f4f9 req-bb9b00cc-8f75-4f94-9603-b334166bfd8c service nova] Creating event network-changed:3f848c01-a648-40ce-965b-af3528a5a06c for instance 902ca0e0-691f-45a3-a98a-8ddfda13473d on hv-cinder-85425 Aug 24 03:52:56.647447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-18efb4ee-db79-4191-800a-21f436d3f4f9 req-bb9b00cc-8f75-4f94-9603-b334166bfd8c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032845 Aug 24 03:52:56.647447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 387/751] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:52:56.871013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:56.871623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:56.882579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.883249 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.883695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.884411 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.884863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.885308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.916926 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:56.917386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:56.917830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:56.918312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'fault' on Instance uuid c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:56.960688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:56.968895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-27586f37-335d-4ad2-84a6-991264748886 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1309 microversion: 2.1 time: 0.101487 Aug 24 03:52:56.969476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 365/752] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:56 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:57.082783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.082783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.090276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.090865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.091381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.092166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.092706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.093140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.145053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.145709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.152170 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.152662 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.153106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.153808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:57.154291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:57.155262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:57.301798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.311349 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.313126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.314467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dd2a7980-3115-4c0e-8531-98215723eea8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.237749 Aug 24 03:52:57.315034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 388/753] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:57.327936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:57.335807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b44c193b-786a-4a22-9e9e-2100b1cf47ea tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1278 microversion: 2.1 time: 0.194656 Aug 24 03:52:57.336371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 366/754] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:52:57.990705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:57.991381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:57.999501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.000009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.000450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.001174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.001630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.002061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.038067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.038590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.039030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.039529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'fault' on Instance uuid c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:58.085816 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.095114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-11b9fdc5-50e0-4f44-bfb0-9fb2f70260ea tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1309 microversion: 2.1 time: 0.108812 Aug 24 03:52:58.095688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 389/755] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:57 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:58.337261 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.337807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.344732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.345221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.345656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.346417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.346870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.347294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.360104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:58.360759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:58.367921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.368684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.369333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.370046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:58.370536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:58.371586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:58.546299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.556539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.560298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.562487 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e22b0fe1-4bd0-4d88-ae75-a1c626cd1290 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.229156 Aug 24 03:52:58.563035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 367/756] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:52:58.576161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:58.585013 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-480656f2-d253-43b5-94d9-47868073bed9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1278 microversion: 2.1 time: 0.229575 Aug 24 03:52:58.586145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 390/757] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:58 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.116378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.116994 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.123421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.123921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.124361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.125209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.125764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.126221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.160309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.160794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.161235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.162392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'fault' on Instance uuid c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:52:59.212623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.223205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b9d6b27e-b646-4c69-bd33-fe928ec0d2b1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 200 len: 1309 microversion: 2.1 time: 0.110764 Aug 24 03:52:59.224193 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 368/758] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.585729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.586474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.594784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.594784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.594784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.595440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.595886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.596307 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.609832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:52:59.610513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:52:59.618329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.618858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.619366 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.620106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:52:59.620591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:52:59.621361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:52:59.817105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.821401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.827819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.829446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:52:59.830349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3d2a2826-a92e-4642-b776-e12a17daf75a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1278 microversion: 2.1 time: 0.226914 Aug 24 03:52:59.830868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-28d81791-b62a-41d8-baaa-3e97eaa4a6fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.249073 Aug 24 03:52:59.831002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 369/759] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:52:59.831714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 391/760] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:52:59 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:00.246799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.246799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: c8ca1d53-be5a-4c9d-8891-0b2735dd8b24] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.251748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.252238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.252735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.253440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.253955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.254336 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.272763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] HTTP exception thrown: Instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 could not be found. Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Request method failure captured: Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 HTTP/1.1 Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ_9f1Nw6NWig4_tvXqBGkAaG4P0GhGooBlSoHQPaKS6UKRiGUNru9uVB3zGTkyNZa-TquXH8OuYRr0TCGrH44d_GA8rxm-_Ol9n8Gng8spp-2eK3kt7qcCgO3Bf4cLpHoBKBTMAg3Y45uB_3Ia1y73mXiBvmbGEgdsx_UPH_SyaLCE Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 46f646fe435e4aa2954af01070537ae4 Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1462751987 Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:53:00.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46f646fe435e4aa2954af01070537ae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46f646fe435e4aa2954af01070537ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46f646fe435e4aa2954af01070537ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46f646fe435e4aa2954af01070537ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-VolumesSnapshotTestJSON-1462751987 Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 46f646fe435e4aa2954af01070537ae4 Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1462751987 Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-VolumesSnapshotTestJSON-1462751987-project Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 5247fd6c30794dc48f60a827d5837674 Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-VolumesSnapshotTestJSON-1462751987-project Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 could not be found. Aug 24 03:53:00.275770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': 'c8ca1d53-be5a-4c9d-8891-0b2735dd8b24'} Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 could not be found. Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:00.276703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 could not be found. Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 could not be found. Aug 24 03:53:00.278080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:00.281585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Returning 404 to user: Instance c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:00.281585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-57ffac54-6153-4606-a474-afd6e562cf66 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24" status: 404 len: 111 microversion: 2.1 time: 0.035332 Aug 24 03:53:00.281585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 370/761] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/c8ca1d53-be5a-4c9d-8891-0b2735dd8b24 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:00.855150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.855750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:00.856282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.856518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:00.865252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.869043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.869043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.869043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.869043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.869386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.872291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.874476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.875802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:00.877322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:00.879457 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:00.880419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:01.145765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:01.159844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:01.167809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-26386300-6ab8-4fed-8de1-75651644e43f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1278 microversion: 2.1 time: 0.320576 Aug 24 03:53:01.172023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:01.173553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:01.174761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-795abf9f-74b7-4397-8d57-344dbfee161e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.322922 Aug 24 03:53:01.178374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 392/762] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:01.178478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 371/763] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:00 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:02.199170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.200406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:02.201024 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.202033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:02.208704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.209207 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.209384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.209854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.210305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.210474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.211241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.211652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:02.211812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.212154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.212676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:02.213325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:02.428498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.440957 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e3f147cd-5e3b-45a1-b5d6-33f46477bf74 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.245748 Aug 24 03:53:02.441947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 393/764] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:02.485194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.496964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.500712 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:02.502425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-927a76b9-ba15-4b88-839e-e87093a377f7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.307085 Aug 24 03:53:02.514533 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 372/765] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:02 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:03.467226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.468904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.476904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.477686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.478131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.478870 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.479404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.480012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.539890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:03.541220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:03.552445 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.552956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.553654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.554447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:03.555113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:03.555707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:03.853985 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.882084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.890807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.895757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:03.912244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6d9e9eff-10d5-460f-8afe-bb45830ae503 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.450469 Aug 24 03:53:03.919447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c8187e00-c6a4-4b97-bc0a-d06c060fabe4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.392397 Aug 24 03:53:03.937302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 394/766] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:03.937474 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 373/767] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:03 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:04.141008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.141771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.157275 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.158301 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.159327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.160589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.161453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.162107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.206660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-79a4e798-d004-4197-a6d8-7ba999014973 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/ips" status: 200 len: 151 microversion: 2.1 time: 0.069804 Aug 24 03:53:04.209588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 395/768] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/ips => generated 151 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:04.222037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b966af59-a662-4d46-b19f-1a9f038786fc"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:04.225221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.234236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.235097 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.235864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.236762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.237484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.240359 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.367205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Invalid volume: volume b966af59-a662-4d46-b19f-1a9f038786fc is already attached to instances: 310ace7e-4d39-4d18-853d-8100b1de8bd3 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: POST /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/os-volume_attachments HTTP/1.1 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 74 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:53:04.368883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {"volumeAttachment": {"volumeId": "b966af59-a662-4d46-b19f-1a9f038786fc"}} Aug 24 03:53:04.370532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Invalid volume: volume b966af59-a662-4d46-b19f-1a9f038786fc is already attached to instances: 310ace7e-4d39-4d18-853d-8100b1de8bd3 Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'server_id': '928f3671-5aef-464f-8035-cc9ee087a394', 'body': {'volumeAttachment': {'volumeId': 'b966af59-a662-4d46-b19f-1a9f038786fc'}}} Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b966af59-a662-4d46-b19f-1a9f038786fc is already attached to instances: 310ace7e-4d39-4d18-853d-8100b1de8bd3 Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:04.371415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b966af59-a662-4d46-b19f-1a9f038786fc is already attached to instances: 310ace7e-4d39-4d18-853d-8100b1de8bd3 Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:04.372902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b966af59-a662-4d46-b19f-1a9f038786fc is already attached to instances: 310ace7e-4d39-4d18-853d-8100b1de8bd3 Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 400 to user: Invalid volume: volume b966af59-a662-4d46-b19f-1a9f038786fc is already attached to instances: 310ace7e-4d39-4d18-853d-8100b1de8bd3 {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ac0e95e4-237f-4684-92ec-c2bd849ec450 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153852 Aug 24 03:53:04.374450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 374/769] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:53:04 2022] POST /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:53:04.393154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.394091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.401182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.401672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.402099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.402849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.403290 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.403912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.448378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:53:04.814543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ab9bb5d6-a35f-402a-99e9-2a06fb369fc4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 204 len: 0 microversion: 2.1 time: 0.437507 Aug 24 03:53:04.816011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 396/770] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:04 2022] DELETE /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:53:04.825417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.827936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.835987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.836901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.837472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.838587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.839157 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.839815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.947862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:04.952607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:04.969471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.970099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.970573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:04.974789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:04.975269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:04.975705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.046981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.062036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1c26c9fc-4b4f-4843-8a97-a64157cc1da6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1683 microversion: 2.1 time: 0.240683 Aug 24 03:53:05.068097 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 375/771] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:05.076921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:05.077786 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:05.087702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.088545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.089154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.090070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:05.090913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:05.091865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:05.114887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:05.214005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.225279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.242529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.246394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-360c9e41-e1ec-4f46-9d09-ed646b5a2dcc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.301079 Aug 24 03:53:05.247390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 397/772] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:04 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:05.296073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:05.305569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-aef90738-fefb-4c16-ac4a-e24bf6c67949 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.234735 Aug 24 03:53:05.306394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 376/773] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:05 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:06.100680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.106119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.126587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.129027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.129488 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.131692 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.132338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.133916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.276269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.277806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.288802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.304598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.304598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.304598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.304598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.305104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.340454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.346400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:06.353474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-201b91aa-ee3f-4bbf-82d4-57e2f8deef2c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1683 microversion: 2.1 time: 0.268040 Aug 24 03:53:06.368480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 398/774] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:06.368480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:06.368480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:06.375409 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.376404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.377346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.380498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:06.381159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:06.382106 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:06.531715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.543651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.548550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.549636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-215d2fda-db1d-4cfc-b92a-f8d46e969edc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.278292 Aug 24 03:53:06.550274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 377/775] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:53:06.620043 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:06.629720 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bfe74d32-b59f-4ea6-bcd0-74ca197aa52d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.274168 Aug 24 03:53:06.630375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 399/776] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:06 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:07.116853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ed9db6-f354-425b-8272-25df40874cee"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:07.121764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.132120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.133440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.133908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.135132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.135909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.136634 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.381604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.382286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.402668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.403849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.404845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.406113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.407121 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.407812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.655782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:07.663814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bd2f71e4-d973-47ea-ad27-ef145051b3a9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1683 microversion: 2.1 time: 0.286070 Aug 24 03:53:07.664394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 400/777] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1683 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:07.694689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:07.695471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:07.705641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.706611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.707224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.709982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:07.709982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:07.709982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:07.977627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:07.990300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:07.992145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:07.994461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6ba7875b-b954-4456-8fee-fd9dd29b91b2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.328589 Aug 24 03:53:07.995558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 401/778] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:08.001823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:08.002810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:08.016909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.016909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.017963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.021377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.022611 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.023337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.321367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.344675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f162cb33-aa21-435c-8552-05bc3e852ef3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.347561 Aug 24 03:53:08.351576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 402/779] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:07 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:08.456592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-394502de-3ae5-4197-b3a4-e2b7849f2b19 req-77678f6a-286b-46b0-b3cc-fb9f3eaf8c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "name": "network-vif-plugged", "status": "completed", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:08.487760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-394502de-3ae5-4197-b3a4-e2b7849f2b19 req-77678f6a-286b-46b0-b3cc-fb9f3eaf8c39 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.490724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-394502de-3ae5-4197-b3a4-e2b7849f2b19 req-77678f6a-286b-46b0-b3cc-fb9f3eaf8c39 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.491216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-394502de-3ae5-4197-b3a4-e2b7849f2b19 req-77678f6a-286b-46b0-b3cc-fb9f3eaf8c39 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.507786 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-394502de-3ae5-4197-b3a4-e2b7849f2b19 req-77678f6a-286b-46b0-b3cc-fb9f3eaf8c39 service nova] Creating event network-vif-plugged:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:53:08.514356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-394502de-3ae5-4197-b3a4-e2b7849f2b19 req-77678f6a-286b-46b0-b3cc-fb9f3eaf8c39 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060880 Aug 24 03:53:08.515562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 403/780] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:08.703094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:08.703094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:08.720917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.722024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.723562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.725227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:08.726096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:08.726946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:08.905791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a19ca5d6-0def-4d6e-80c6-497075b2e19a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.796724 Aug 24 03:53:08.928160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 378/781] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:53:07 2022] POST /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments => generated 194 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:08.931895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:08.961956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c3e3ae2f-2ec6-4d6d-a09c-a486f1e0bda6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1683 microversion: 2.1 time: 0.276392 Aug 24 03:53:08.963064 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 404/782] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:08 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1683 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:09.030347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.031396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.049789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.050446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.050926 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.052075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.053697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.054392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.247461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:09.264091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:09.267428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:09.267428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6ef64d6b-3e42-468b-b503-fab8fb70e85f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.241646 Aug 24 03:53:09.267707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 379/783] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:09.390167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.392193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.399653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.400341 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.400883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.401734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.405527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.406230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.647488 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:09.659013 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-46de9ed7-92a0-4be0-808a-34153ed27516 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.278809 Aug 24 03:53:09.673751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 405/784] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:09.737039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-4b1e2574-7b53-4ab3-8d1c-f47356eab1b2 req-9b4530f6-ac45-43a0-9785-4323e190f93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928f3671-5aef-464f-8035-cc9ee087a394", "name": "network-vif-deleted", "tag": "1a683477-a998-4ddb-8c06-dfa7486b6620"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:09.758871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-4b1e2574-7b53-4ab3-8d1c-f47356eab1b2 req-9b4530f6-ac45-43a0-9785-4323e190f93c service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:09.759374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-4b1e2574-7b53-4ab3-8d1c-f47356eab1b2 req-9b4530f6-ac45-43a0-9785-4323e190f93c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:09.760380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-4b1e2574-7b53-4ab3-8d1c-f47356eab1b2 req-9b4530f6-ac45-43a0-9785-4323e190f93c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:09.784800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-4b1e2574-7b53-4ab3-8d1c-f47356eab1b2 req-9b4530f6-ac45-43a0-9785-4323e190f93c service nova] Creating event network-vif-deleted:1a683477-a998-4ddb-8c06-dfa7486b6620 for instance 928f3671-5aef-464f-8035-cc9ee087a394 on hv-cinder-85425 Aug 24 03:53:09.792836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-4b1e2574-7b53-4ab3-8d1c-f47356eab1b2 req-9b4530f6-ac45-43a0-9785-4323e190f93c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060854 Aug 24 03:53:09.793802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 380/785] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:09.988190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:09.989185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:09.999749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.000542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.001183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.002075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.002767 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.003360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.113641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.131157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8f17c94b-70e7-4de4-b0ff-c86f732f4792 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1615 microversion: 2.1 time: 0.147430 Aug 24 03:53:10.131728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 406/786] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:09 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1615 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:10.292477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:10.297523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:10.307773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.308319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.308816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.309581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.310074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.319660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.584651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.597123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.599168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.600602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d9c78d81-4b19-4f1d-a40d-747198fb0da4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.313154 Aug 24 03:53:10.615228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 381/787] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:10 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:10.680702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:10.682244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:10.690204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.691063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.691878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.692791 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:10.693414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:10.694005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:10.929114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:10.940740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d51b04a3-ac12-4a98-b06e-229d0b3cc41f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.264093 Aug 24 03:53:10.946454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 407/788] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:10 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:11.162562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.163323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:11.183337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.183848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.184502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.185231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.186034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.187046 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.300470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:11.311773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e235bd76-bae8-48a8-a3ae-10a492e36a6f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1615 microversion: 2.1 time: 0.161956 Aug 24 03:53:11.312815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 382/789] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1615 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:11.629027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.631462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:11.645972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.646947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.647095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.648019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.648482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.648904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.822795 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:11.835033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:11.836993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:11.838558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a916664e-b065-4120-99d4-8ddb3af80900 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.216162 Aug 24 03:53:11.839760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 408/790] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:11.968428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:11.969213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:11.976075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.976569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.977034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:11.977720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:11.978191 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:11.978662 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.164829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:12.181829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d2d40c2d-af8f-4b21-bfd6-02055159c532 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.217059 Aug 24 03:53:12.184422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 383/791] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:11 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:12.333049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:12.334541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:12.350114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.354459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.358117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.359219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.365534 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.365997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.463938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:12.478362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-18353ca3-87be-490b-ac92-9ca67749d0b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1326 microversion: 2.1 time: 0.149104 Aug 24 03:53:12.494218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 409/792] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:12 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:12.864273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:12.865418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:12.873505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.874277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.874840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:12.875709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:12.876410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:12.876937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.034471 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.047465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.050594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.052255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6b501b9c-ccb7-4c6c-a863-21c16cebeace tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.193696 Aug 24 03:53:13.052968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 384/793] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:12 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:13.209699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:13.210394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:13.219196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.219715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.220156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.221064 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.221713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.222370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.379980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.392636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-193c06b4-917a-4df1-8b7f-d7b25ac4fb37 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.187650 Aug 24 03:53:13.394420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 410/794] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:13 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:13.472852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1978598788", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "networks": [{"uuid": "669e757e-aac3-47cd-bcd1-cfc4cc29b424"}]}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:13.501588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:13.502263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:13.508244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.508781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.509200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.510112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.510601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.511044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.546413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:13.547260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:13.547873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:13.548507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'fault' on Instance uuid 928f3671-5aef-464f-8035-cc9ee087a394 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:13.548641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] validate_networks() for [('669e757e-aac3-47cd-bcd1-cfc4cc29b424', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:53:13.618760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:13.633298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-aea29ca4-5b05-4e39-be4c-96d149dc29b8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1331 microversion: 2.1 time: 0.136183 Aug 24 03:53:13.635507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 411/795] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:13 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:14.028988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:53:14.030337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:53:14.031065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:53:14.031689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:53:14.032298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:53:14.042458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.043284 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.043764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.045177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.045951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.046669 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.065208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Getting quotas for project 46f646fe435e4aa2954af01070537ae4. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:14.069494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Getting quotas for user 5247fd6c30794dc48f60a827d5837674 and project 46f646fe435e4aa2954af01070537ae4. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:14.077291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.078221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.089449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.090038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.090504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.091253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.091753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.092378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.103075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:53:14.110212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:53:14.288043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-605d565f-a617-420a-82ba-2e8ff579ef7e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818815 Aug 24 03:53:14.293123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 385/796] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:53:14.306814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3f0d2439-de20-4da9-b3ba-c5fcce0eb590 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.306927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3f0d2439-de20-4da9-b3ba-c5fcce0eb590 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.440066 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3f0d2439-de20-4da9-b3ba-c5fcce0eb590 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.456890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3f0d2439-de20-4da9-b3ba-c5fcce0eb590 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1219 microversion: 2.1 time: 0.152444 Aug 24 03:53:14.456890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 386/797] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:14.461345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.462066 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.488913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.493828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.494903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.495285 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.496634 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.497308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.556545 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.570946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.571192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.572311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4800b600-6665-4081-8533-7616d790245f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.499157 Aug 24 03:53:14.573071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 412/798] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:53:14.661528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:14.662664 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:14.680087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.681921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.684889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.688783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.689925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.690629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.727745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:14.728236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:14.728875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:14.729497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'fault' on Instance uuid 928f3671-5aef-464f-8035-cc9ee087a394 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:14.818140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.829049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d7dea430-809b-4a4c-ac5a-943c4239e664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1331 microversion: 2.1 time: 0.172161 Aug 24 03:53:14.830800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 413/799] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1331 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:14.842886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:14.852517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-23cdce5a-6706-4a10-8814-8dc1f4a0bb20 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.395881 Aug 24 03:53:14.853096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 387/800] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:14 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:15.480911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:15.482547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:15.489421 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.489911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.490386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.491309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.491939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.492546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.562143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.571402 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0c92854d-b165-4702-a314-a6b6ac35b70c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1223 microversion: 2.1 time: 0.094292 Aug 24 03:53:15.572544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 414/801] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:15 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:15.601707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:15.603077 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:15.613972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.614795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.615155 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.616106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.616677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.617295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.771606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.785290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.787279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.788863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e8b444d9-bc69-44de-8172-a04b720f0e30 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.193508 Aug 24 03:53:15.790041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 388/802] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:15 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:15.851221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:15.852361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:15.861229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.861721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.862191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.862890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.863351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.863810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.880536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:15.882307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:15.887384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:15.888539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.889395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.889872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.891458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.892105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.892716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.905419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:15.906176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:15.906757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:15.907230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'fault' on Instance uuid 928f3671-5aef-464f-8035-cc9ee087a394 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:15.955271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:15.964469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6f4a066f-3dc7-450a-8ca3-d4f2c1bd1fa7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 200 len: 1331 microversion: 2.1 time: 0.118136 Aug 24 03:53:15.978953 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 415/803] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:15 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:16.127792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:16.143846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f196360b-36f2-4dfb-a2d6-76e302feadb2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.267280 Aug 24 03:53:16.145019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 389/804] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:15 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:16.596260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:16.597138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:16.606842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.607691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.608448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.609342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.609805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.610429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.699765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:16.712664 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-41968377-4891-406b-a5cb-f6199335301e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1223 microversion: 2.1 time: 0.121188 Aug 24 03:53:16.713737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 416/805] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:16.814561 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:16.815214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:16.822110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.822682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.823112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:16.823832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:16.824280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:16.825063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.003250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:17.005304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:17.022598 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.023379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.024024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.025174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.025890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.026395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.054523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 HTTP/1.1 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:53:17.056871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:53:17.058753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '928f3671-5aef-464f-8035-cc9ee087a394'} Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:17.059693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:53:17.062049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:17.063548 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:17.063548 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f47612ec-ae52-429e-a310-6ec6a98c9492 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 404 len: 111 microversion: 2.1 time: 0.065162 Aug 24 03:53:17.065738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 417/806] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:17.070944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b54f051c-6b79-4f7a-ba66-720587b57864 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '.version_select at 0x7f6c13739790>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:17.078793 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:17.095908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:17.114086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:17.114086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:17.114086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0a46d194-0025-4cc6-8413-813fdfec1ece tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.300087 Aug 24 03:53:17.115084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 390/807] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:16 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:17.175788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b54f051c-6b79-4f7a-ba66-720587b57864 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-167520712" status: 202 len: 0 microversion: 2.1 time: 0.108409 Aug 24 03:53:17.177038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 418/808] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 03:53:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-167520712 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:17.272704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:17.272704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:17.272704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.272704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.273165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.273165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.273165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.273165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.478965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:17.488784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ad10df7e-0bde-44a9-bdf1-c2da46ce9e3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.243654 Aug 24 03:53:17.489882 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 391/809] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:17 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:17.744308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:17.753584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:17.803525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.807156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.807156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.807156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:17.808064 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:17.809980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:17.933329 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:17.944541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ea84052e-8dd6-4715-8859-10e87dc5984a tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1215 microversion: 2.1 time: 0.210130 Aug 24 03:53:17.951393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 419/810] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:17 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:18.133816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.143376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:18.149963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.157677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.162543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.163508 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.166499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.167268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.372025 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.391529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.396538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.399890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-248a63d5-f90d-4123-a67a-492befe3b3ca tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.268627 Aug 24 03:53:18.424008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 392/811] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:18 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:18.425423 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.426008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:18.433050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.433809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.434449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.435447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.436119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.436703 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.528245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.532237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:18.555881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.558326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.559044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.561156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.563452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.566574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.627062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'services' on Instance uuid 310ace7e-4d39-4d18-853d-8100b1de8bd3 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:18.825075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:18.834057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-57f7e8da-b9de-4ed6-bc96-beb3668be33d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.320771 Aug 24 03:53:18.834847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 393/812] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:18 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:18.969725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.970565 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:18.974531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-afb20b48-2dbb-4325-8ae3-6e07c695306f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments/b966af59-a662-4d46-b19f-1a9f038786fc" status: 202 len: 0 microversion: 2.1 time: 0.555379 Aug 24 03:53:18.976399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 420/813] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:53:18 2022] DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments/b966af59-a662-4d46-b19f-1a9f038786fc => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:18.979553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.980218 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.980836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.981681 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:18.983346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:18.983887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:18.989893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:18.990119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:18.992303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:19.005932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.006437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.006870 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.007579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.008027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.008447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.058406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-defa11d8-0fce-480d-93f2-1e57befb1a43 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077063 Aug 24 03:53:19.060254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 421/814] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:18 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:19.085481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:19.095796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-37d158a5-99f7-4767-893f-4fb13cd63d99 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1271 microversion: 2.1 time: 0.131166 Aug 24 03:53:19.096766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 394/815] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:18 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:19.334443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-ea4750cd-1b42-4e47-b4fb-970516a632b5 req-cf11d751-f827-4230-9fed-f90531e0afa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ca0e0-691f-45a3-a98a-8ddfda13473d", "name": "network-vif-plugged", "status": "completed", "tag": "3f848c01-a648-40ce-965b-af3528a5a06c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:19.377352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ea4750cd-1b42-4e47-b4fb-970516a632b5 req-cf11d751-f827-4230-9fed-f90531e0afa5 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.378780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ea4750cd-1b42-4e47-b4fb-970516a632b5 req-cf11d751-f827-4230-9fed-f90531e0afa5 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.380844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ea4750cd-1b42-4e47-b4fb-970516a632b5 req-cf11d751-f827-4230-9fed-f90531e0afa5 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.429248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-ea4750cd-1b42-4e47-b4fb-970516a632b5 req-cf11d751-f827-4230-9fed-f90531e0afa5 service nova] Creating event network-vif-plugged:3f848c01-a648-40ce-965b-af3528a5a06c for instance 902ca0e0-691f-45a3-a98a-8ddfda13473d on hv-cinder-85425 Aug 24 03:53:19.431087 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:19.431718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:19.444404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-ea4750cd-1b42-4e47-b4fb-970516a632b5 req-cf11d751-f827-4230-9fed-f90531e0afa5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117575 Aug 24 03:53:19.445667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.446485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.447935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.449273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.449535 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 422/816] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:19.450279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.452292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.661995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:19.675970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:19.677815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:19.679127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-da704ebd-b57c-4970-bb4e-1620772c5fd0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1806 microversion: 2.20 time: 0.252349 Aug 24 03:53:19.684113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 395/817] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:19 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1806 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:19.855964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:19.857093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:19.864519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.865055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.865452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:19.866190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:19.866652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:19.867087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.066731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.072643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:20.075175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:20.082803 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-54249853-ec0b-41d7-bd4b-ed1c63b92d22 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.231106 Aug 24 03:53:20.083397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 423/818] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:19 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:20.089591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:20.092441 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:20.099442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.099935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.100381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.100540 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.101097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.101510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.101632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.101997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.102111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.103302 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.103980 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.104433 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.141010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'flavor' on Instance uuid 611ffff0-163e-4c5f-83be-b31e72dd599c {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:20.147403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-416e30f6-13de-48e9-b869-2199f7acdfbe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078940 Aug 24 03:53:20.148876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 396/819] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:20 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:20.154439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:20.155592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:20.162653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.163465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.165011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.165958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.166715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.167389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.241493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.255391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-779dc495-fbac-4ea3-87ea-2fed79a74978 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1279 microversion: 2.1 time: 0.105055 Aug 24 03:53:20.256477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 397/820] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:20 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:20.574091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-31b80360-d5a7-400a-9283-1621ccf9314a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/action" status: 200 len: 32 microversion: 2.1 time: 0.489339 Aug 24 03:53:20.582102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 424/821] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:53:20 2022] POST /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:53:20.587334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:20.588143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:20.593036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:20.603514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.605851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.606560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.610439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.610991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.611494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.709569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:20.710424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:20.732697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.733753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.734417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.735328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:20.735972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:20.738955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:20.893450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.903112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-69ad572b-1eef-40e3-b200-f5591b127fd5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.319856 Aug 24 03:53:20.903775 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 398/822] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:20 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:20.955189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.964126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.965888 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:20.967366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-407b3244-ed58-40a0-8d7a-141ab94dec97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1793 microversion: 2.20 time: 0.262433 Aug 24 03:53:20.967926 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 425/823] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:53:20 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1793 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:53:21.104764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.105682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.113141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.113923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.114676 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.115713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.116698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.117405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.164125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.176192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.183783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.184562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.185278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.186550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.187581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.188224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.247217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-42270a6e-80db-4845-9c94-5c4bfb6362cc tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089605 Aug 24 03:53:21.252719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 426/824] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:21.281973 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.283438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.290918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.291505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.292135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.292916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.293453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.293973 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.349072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:21.363143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d06da09d-347c-41e3-89b0-fbec056fe6cc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.260723 Aug 24 03:53:21.380708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 399/825] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:21.435700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:21.443677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8253020e-1c58-4cb3-9d0c-9d15d1a1e54e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1289 microversion: 2.1 time: 0.167777 Aug 24 03:53:21.445135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 427/826] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1289 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:21.926865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:21.927471 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:21.934693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.935826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.936549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:21.937255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:21.937701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:21.938120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.081787 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:22.090575 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3d76c0bb-a25f-41ec-9e43-eac99d8fe315 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.168813 Aug 24 03:53:22.091939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 400/827] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:21 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:22.263573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.270078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.277761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.278285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.278761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.280198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.280651 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.281074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.313748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b621a039-0bf4-4d36-a164-8b8eca982de1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057696 Aug 24 03:53:22.318220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 428/828] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:53:22.379924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.380629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.384110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.384730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.387686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.388856 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.389583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.390478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.391036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.391557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.392790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.393319 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.393890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.394633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.395092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.395525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.419699 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:53:22.536570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:22.544931 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f4fdbe8a-277c-4183-af0c-25ee18c3ed4d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1266 microversion: 2.1 time: 0.164155 Aug 24 03:53:22.545505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 429/829] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:22.550046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.550696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.556599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.557087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.557525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.558253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.564549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.564549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.698262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:22.706528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-be384741-f440-469b-85e8-ddade3275e77 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.159948 Aug 24 03:53:22.707112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 430/830] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:22.731105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b38cf18c-eb58-4b6a-9b6d-d6dd2d9fffd0 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 204 len: 0 microversion: 2.1 time: 0.354768 Aug 24 03:53:22.731877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 401/831] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:53:22 2022] DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:53:22.749391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:22.750008 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:22.756322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.756814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.757268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.757999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:22.758524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:22.758993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:22.782064 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:22.992300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.001588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-90d9d338-4518-4113-abac-92b67459aa66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1682 microversion: 2.1 time: 0.256403 Aug 24 03:53:23.002194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 431/832] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:22 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:23.114203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.114927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:23.121169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.121655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.122091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.123461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.123919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.124340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.258550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.267892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3ac0ba7b-7413-48dc-a484-422cedc167b6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.157822 Aug 24 03:53:23.268480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 402/833] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:23 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:23.566141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.572654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-ab0da7b2-4b67-4883-b900-3912dda47fda req-c680ee65-2f5a-4ec0-940f-3d9619c27446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530", "tag": "ace9097f-c5f9-481f-9643-da2a1bac6edb"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:23.574000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:23.584554 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ab0da7b2-4b67-4883-b900-3912dda47fda req-c680ee65-2f5a-4ec0-940f-3d9619c27446 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.585209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ab0da7b2-4b67-4883-b900-3912dda47fda req-c680ee65-2f5a-4ec0-940f-3d9619c27446 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.587349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ab0da7b2-4b67-4883-b900-3912dda47fda req-c680ee65-2f5a-4ec0-940f-3d9619c27446 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.589984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.592016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.593156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.594115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.595090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.595832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.599842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-ab0da7b2-4b67-4883-b900-3912dda47fda req-c680ee65-2f5a-4ec0-940f-3d9619c27446 service nova] Creating event network-changed:ace9097f-c5f9-481f-9643-da2a1bac6edb for instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 on hv-cinder-85425 Aug 24 03:53:23.605089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-ab0da7b2-4b67-4883-b900-3912dda47fda req-c680ee65-2f5a-4ec0-940f-3d9619c27446 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039557 Aug 24 03:53:23.605943 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 403/834] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:23.729124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.729721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:23.737045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.737727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.738247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.738690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.739401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.739853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.740281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.745292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e64e2bb1-4b02-491a-912d-42f4724bb227 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1453 microversion: 2.1 time: 0.183475 Aug 24 03:53:23.745990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 432/835] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:23 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1453 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:23.769359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:23.770003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:23.776333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.776825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.777269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.777977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:23.778499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:23.779568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:23.944804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.954656 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a8381a0d-e56a-468a-ab36-efbfe4e7b8f7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.229998 Aug 24 03:53:23.966179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 404/836] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:23 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:23.967133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:23.969278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1daf32b5-97a9-4895-8d38-0c93f8ce1634 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1453 microversion: 2.1 time: 0.203482 Aug 24 03:53:23.970933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 433/837] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:23 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:24.022647 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:24.023263 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:24.030392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.031004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.031518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.032302 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.032842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.033337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.056660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:24.180516 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:24.189346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fd468881-06f7-404a-b1cd-3f47862a0286 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1682 microversion: 2.1 time: 0.170541 Aug 24 03:53:24.189934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 405/838] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:24 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:24.289399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:24.290025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:24.296262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.296801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.300157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.300157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.300157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.300157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.447967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:24.457531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b61bca2e-7dfb-4b63-a2bf-e86e331ccc33 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.172029 Aug 24 03:53:24.458435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 434/839] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:24 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:24.978745 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:24.979461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:24.981422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=8 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:24.987915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.988495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.988927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:24.989631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:24.990080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:24.990537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.140280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.149509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-54340c5d-1a78-4149-bdba-d7530e0a9051 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.174319 Aug 24 03:53:25.150004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 406/840] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:24 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:25.212049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.212943 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.220737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.221220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.221702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.222467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.222978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.223399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.367995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.376538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2a640612-a7eb-4d92-9fa8-589c3684b392 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1682 microversion: 2.1 time: 0.168451 Aug 24 03:53:25.377114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 435/841] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:25.479075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:25.479675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:25.486560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.487087 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.487523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.488226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:25.488913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:25.489342 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:25.634861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:25.645242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-39979aa2-556a-4f5f-a893-233784c69795 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.169970 Aug 24 03:53:25.646083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 407/842] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:25 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:26.171956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.172607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:26.179043 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.179563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.180059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.180756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.181201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.181640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.320063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:26.328881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5ca416cb-592e-4fdc-a94d-1a80eaa7f7d4 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.161850 Aug 24 03:53:26.329486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 436/843] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:26.405438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.406679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:26.418912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.421749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.422454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.423516 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.424177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.424762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.548298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-73e1541f-d4fb-4506-91c1-bd4c0a225337 req-f225a789-79cd-4cd9-ae19-52cc3abb5ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ca0e0-691f-45a3-a98a-8ddfda13473d", "tag": "3f848c01-a648-40ce-965b-af3528a5a06c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:26.558774 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-73e1541f-d4fb-4506-91c1-bd4c0a225337 req-f225a789-79cd-4cd9-ae19-52cc3abb5ab1 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.559393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-73e1541f-d4fb-4506-91c1-bd4c0a225337 req-f225a789-79cd-4cd9-ae19-52cc3abb5ab1 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.562682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-73e1541f-d4fb-4506-91c1-bd4c0a225337 req-f225a789-79cd-4cd9-ae19-52cc3abb5ab1 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.572828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-73e1541f-d4fb-4506-91c1-bd4c0a225337 req-f225a789-79cd-4cd9-ae19-52cc3abb5ab1 service nova] Creating event network-changed:3f848c01-a648-40ce-965b-af3528a5a06c for instance 902ca0e0-691f-45a3-a98a-8ddfda13473d on hv-cinder-85425 Aug 24 03:53:26.578880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:26.580122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-73e1541f-d4fb-4506-91c1-bd4c0a225337 req-f225a789-79cd-4cd9-ae19-52cc3abb5ab1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036187 Aug 24 03:53:26.581225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 437/844] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:26.591986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-acea9c92-f158-4060-ace7-53b92a553ee6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1682 microversion: 2.1 time: 0.192524 Aug 24 03:53:26.591986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 408/845] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:26.668351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:26.669058 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:26.677191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.677777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.678252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:26.679256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:26.679674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:26.679939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.069505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.090009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-38ecd56a-e58e-4c53-a1d8-17521a72bb2f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.422919 Aug 24 03:53:27.092150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 438/846] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:26 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:27.353177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:27.354173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:27.376736 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.376736 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.376909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.377555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.378857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.379536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.612113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:27.613407 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:27.620792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.621289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.621734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.622529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:27.623096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:27.623562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:27.796922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.805127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:27.808189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4e64c190-5238-4f85-964d-e1ec84ecc0d3 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.458985 Aug 24 03:53:27.809287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 409/847] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:27 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:27.877433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:27.905956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f6fad712-2b51-460b-8748-20869181456f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1682 microversion: 2.1 time: 0.296877 Aug 24 03:53:27.907302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 439/848] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:27 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1682 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:28.112386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.113002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.120335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.120716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.121152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.121892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.123086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.123604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.268589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:28.277495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ad694529-9456-4e9f-843f-51384a0e1039 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.169332 Aug 24 03:53:28.278089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 410/849] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:28.834626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.836046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.845482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.846119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.846693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.847512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.848109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.848625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.927878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:28.929256 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:28.937733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.938383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.938918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:28.939776 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:28.940324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:28.940844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.049861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:29.052373 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:29.063432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ef1243de-7c20-4bb7-8b66-e505d1128576 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1615 microversion: 2.1 time: 0.139433 Aug 24 03:53:29.066682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 411/850] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1615 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:29.069728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3f010539-862c-4026-a283-56c51342062f tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.244550 Aug 24 03:53:29.078435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 440/851] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:28 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:29.118183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-0f01020c-bee3-41d6-88c3-dfd3a73dae76 req-c7231a29-ac46-4766-9cff-58ac4a6af5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310ace7e-4d39-4d18-853d-8100b1de8bd3", "name": "network-vif-deleted", "tag": "26bb2b47-4acd-4d88-9312-b50d50ebd4e7"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:29.138971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-0f01020c-bee3-41d6-88c3-dfd3a73dae76 req-c7231a29-ac46-4766-9cff-58ac4a6af5b9 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.139681 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-0f01020c-bee3-41d6-88c3-dfd3a73dae76 req-c7231a29-ac46-4766-9cff-58ac4a6af5b9 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.140608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-0f01020c-bee3-41d6-88c3-dfd3a73dae76 req-c7231a29-ac46-4766-9cff-58ac4a6af5b9 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.158460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-0f01020c-bee3-41d6-88c3-dfd3a73dae76 req-c7231a29-ac46-4766-9cff-58ac4a6af5b9 service nova] Creating event network-vif-deleted:26bb2b47-4acd-4d88-9312-b50d50ebd4e7 for instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 on hv-cinder-85425 Aug 24 03:53:29.164999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-0f01020c-bee3-41d6-88c3-dfd3a73dae76 req-c7231a29-ac46-4766-9cff-58ac4a6af5b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059878 Aug 24 03:53:29.165708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 412/852] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:29.303467 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:29.304452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:29.310538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.311059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.311506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.312226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:29.312885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:29.313351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:29.482310 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:29.491570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-732f17a4-8c30-45e9-a56c-44f1c79b754b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.192995 Aug 24 03:53:29.503194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 441/853] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:29 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:30.098981 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:30.100430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:30.109825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.111804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.112684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.113772 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.114492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.115392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.272402 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.281844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7bee3c4d-266e-49ff-8bb1-f166b5da54bd tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.189295 Aug 24 03:53:30.282483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 442/854] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:30 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:30.315536 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:30.316296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:30.322731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.323209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.323865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.324654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.325270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.326317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.395778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.403927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-399ab7aa-0f46-4299-88c9-5fb0d8d776dd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1326 microversion: 2.1 time: 0.315138 Aug 24 03:53:30.404500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 413/855] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:30 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1326 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:30.514482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:30.515382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:30.521430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.521945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.522445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.523152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:30.523785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:30.524298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:30.663967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:30.672326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0608573e-6414-4c56-a69f-e491c12a29b3 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.161676 Aug 24 03:53:30.672902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 443/856] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:30 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:31.303018 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.303646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.310025 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.310548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.311856 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.312832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.313287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.313796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.426068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.427557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.435396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.436629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.437078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.438288 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.439074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.439865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.465512 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:31.474453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c0bd15af-cd43-4846-8193-63ef3220bc13 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.175312 Aug 24 03:53:31.475069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 414/857] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:31.510915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:31.518833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3c312a57-f15c-4a07-8bfd-804a77e17e09 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1326 microversion: 2.1 time: 0.096889 Aug 24 03:53:31.519385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 444/858] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:31.870788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:31.871778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:31.878639 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.878841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.882668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:31.882668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:31.882668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:31.882668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.013588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.022891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6d3450b3-4476-41b9-b953-27a23af271aa tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.333345 Aug 24 03:53:32.023472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 415/859] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:31 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.496063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:32.496686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:32.505118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.505659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.506139 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.506898 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.507414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.507845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.541245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:32.542539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:32.549849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.550364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.550823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.551505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.552078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.552515 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.595691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:32.596189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:32.596628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:32.597087 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'fault' on Instance uuid 310ace7e-4d39-4d18-853d-8100b1de8bd3 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:32.655603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.663488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-15b5da95-08eb-4373-af26-9d97ee420dcb tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 200 len: 1331 microversion: 2.1 time: 0.126260 Aug 24 03:53:32.663978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 416/860] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:32 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:32.678131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:32.693395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6d416ed6-4fd1-411a-9506-a5d09a9b8f05 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.201298 Aug 24 03:53:32.693976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 445/861] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:32 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:33.044725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.045798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.052029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.052530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.052974 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.053685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.054144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.055435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.204167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:33.213112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a1656311-3735-40b9-8856-21562c87c9eb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.172368 Aug 24 03:53:33.213895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 417/862] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:33.685142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.685746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.692419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.692901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.693338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.694035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.694514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.694940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.709110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 HTTP/1.1 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:53:33.710924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:53:33.712344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '310ace7e-4d39-4d18-853d-8100b1de8bd3'} Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:33.713090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:53:33.714649 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:33.715872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:33.715872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7abbc6a2-c3b5-4a0e-becf-f48ebbd37ced tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 404 len: 111 microversion: 2.1 time: 0.031082 Aug 24 03:53:33.715872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 446/863] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:33.721777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-08437be4-12f7-4f91-9255-169be46bc895 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '.version_select at 0x7f6c136829d0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.721947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:33.722570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:33.729465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.730382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.730496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.731200 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:33.731641 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:33.732068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:33.812055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-08437be4-12f7-4f91-9255-169be46bc895 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-569282096" status: 202 len: 0 microversion: 2.1 time: 0.094591 Aug 24 03:53:33.812623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 447/864] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 03:53:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-569282096 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:53:33.908808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:33.917080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-45367a02-c1c4-4757-b2bd-399e65c6347e tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.199786 Aug 24 03:53:33.917683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 418/865] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:33 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:34.237510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:34.238126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:34.244434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.244920 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.245364 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.246277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.246738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.247164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.388083 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:34.397463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6e18e399-9106-4fe0-a474-4aa21b458b28 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.164882 Aug 24 03:53:34.398036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 448/866] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:34 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:34.631891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0a3ee3ee-aa35-45a0-9ab8-0137deb83e9d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: .version_select at 0x7f6c135f7d30>, body: {"keypair": {"name": "tempest-keypair-706220841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl98/uwrbD6Rlz+w9apAxvyHHET6viJDM82DlmQf/fki45qVoW2BgmwNq5S1w8543rl7JCqGwptI01VNZcFS/C0jBP7+7PP6in7zH5VOf8BN1ZRAiuiQfDowURs1RCs6w=="}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:34.647879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-0a3ee3ee-aa35-45a0-9ab8-0137deb83e9d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:34.652135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-0a3ee3ee-aa35-45a0-9ab8-0137deb83e9d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:34.783566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0a3ee3ee-aa35-45a0-9ab8-0137deb83e9d tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155607 Aug 24 03:53:34.784279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 419/867] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:53:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:34.939620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:34.940361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:34.947143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.947638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.948085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:34.948794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:34.949255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:34.949688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.087070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:35.095438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9648a160-24d5-4335-b08e-4a12ef2ba993 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.160394 Aug 24 03:53:35.096131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 449/868] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:34 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:35.424518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:35.425228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:35.431684 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.432171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.432611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.433314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.433889 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.436011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.600011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:35.610472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ececa3df-50fc-4c06-b1f4-4c14010064bd tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.189792 Aug 24 03:53:35.610472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 420/869] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:35 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:35.811540 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-d82f7db3-9dea-45c9-8ee1-da60cad51acc req-82bf31bf-1ede-42d4-9b24-c56cd29f682b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530", "name": "network-vif-plugged", "status": "completed", "tag": "ace9097f-c5f9-481f-9643-da2a1bac6edb"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:35.815158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d82f7db3-9dea-45c9-8ee1-da60cad51acc req-82bf31bf-1ede-42d4-9b24-c56cd29f682b service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:35.815714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d82f7db3-9dea-45c9-8ee1-da60cad51acc req-82bf31bf-1ede-42d4-9b24-c56cd29f682b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:35.816376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d82f7db3-9dea-45c9-8ee1-da60cad51acc req-82bf31bf-1ede-42d4-9b24-c56cd29f682b service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:35.829011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-d82f7db3-9dea-45c9-8ee1-da60cad51acc req-82bf31bf-1ede-42d4-9b24-c56cd29f682b service nova] Creating event network-vif-plugged:ace9097f-c5f9-481f-9643-da2a1bac6edb for instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 on hv-cinder-85425 Aug 24 03:53:35.834710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-d82f7db3-9dea-45c9-8ee1-da60cad51acc req-82bf31bf-1ede-42d4-9b24-c56cd29f682b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035513 Aug 24 03:53:35.835322 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 421/870] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:53:35.997433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:36.003477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:36.004505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.004987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.005418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.006104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.006626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.007051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.026273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:36.105468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lazy-loading 'services' on Instance uuid 2dd163bb-cead-4664-bfcc-59aa1b1f920f {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:53:36.118824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:36.119838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:36.128033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.128466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.128907 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.129611 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.130067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.130560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.330485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8ee040b9-7e62-4680-820d-cd0f62b8a56f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-volume_attachments/4edfbfd2-50c5-475a-aad3-cd61211cb09a" status: 202 len: 0 microversion: 2.1 time: 0.543351 Aug 24 03:53:36.331579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 450/871] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:53:35 2022] DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-volume_attachments/4edfbfd2-50c5-475a-aad3-cd61211cb09a => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:36.346955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:36.357539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9c5ca473-d30c-47d9-bbda-d04d1f4ad724 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.243558 Aug 24 03:53:36.358888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 422/872] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:36 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:36.631728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:36.632431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:36.644264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.644264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.644264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.644264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:36.644914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:36.644914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:36.808249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:36.818081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5dae0921-d6f7-4099-b7ca-f138caaf052e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.190865 Aug 24 03:53:36.818691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 451/873] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:36 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:37.398649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1389005980", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7017dfb2-6dc7-4b44-a632-2d85a8be9995"}], "security_groups": [{"name": "tempest-securitygroup--1222190508"}], "key_name": "tempest-keypair-706220841", "user_data": "}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:37.443705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.444408 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.451495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.451875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.452146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.453876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.454443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.454937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.548791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] validate_networks() for [('7017dfb2-6dc7-4b44-a632-2d85a8be9995', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:53:37.683682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:37.691977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c6ee190d-9181-4e9d-bc19-2d7102ba763b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1319 microversion: 2.1 time: 0.252669 Aug 24 03:53:37.692645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 452/874] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:37 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:37.840367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:37.841092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:37.847681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.848176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.848616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:37.849344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:37.849802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:37.850314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.072215 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:38.081668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a95c81cc-6b93-4396-8ec2-ccbc8341a22b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.245258 Aug 24 03:53:38.083081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 453/875] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:37 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:38.177324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:53:38.177813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:53:38.178388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:53:38.178796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:53:38.179203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:53:38.189876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.190392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.190823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.191548 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.191992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.192484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.211962 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:53:38.216300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:53:38.228720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:53:38.231073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:53:38.391772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-26cfbeef-6cb9-4084-9b93-8284da4e9116 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.997375 Aug 24 03:53:38.392435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 423/876] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:53:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:53:38.404431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-21fd42bc-5566-493e-9583-ed17445e0ee3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.405343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-21fd42bc-5566-493e-9583-ed17445e0ee3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.485755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-21fd42bc-5566-493e-9583-ed17445e0ee3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:38.499231 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-21fd42bc-5566-493e-9583-ed17445e0ee3 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1241 microversion: 2.1 time: 0.096956 Aug 24 03:53:38.499231 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 454/877] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:38.712788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:38.713491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.729242 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.729733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.730275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.730944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.731396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.731809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.884272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:38.894429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-145f10d2-26d4-40d5-85b4-c2476700dc08 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1509 microversion: 2.1 time: 0.186172 Aug 24 03:53:38.895008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 424/878] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:38 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:38.915818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05f82214-118d-4b42-9ab2-66a0d9f31ba8", "device": "/dev/sdb"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:38.918765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:38.927380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.927872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.928310 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:38.929011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:38.929470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:38.929889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.106459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:39.107885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:39.123583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.123583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.123583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.123583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.124001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.124288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.269072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:39.277645 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7a4a1e7d-46b9-4960-a645-a9e557a53c0f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.175067 Aug 24 03:53:39.278246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 425/879] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:39 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:39.518811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:39.519429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:39.525874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.526390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.526825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.527514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:39.527957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:39.528400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:39.600346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:39.609151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-53d8eb2a-6154-4aac-b767-f46421ec5e53 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1245 microversion: 2.1 time: 0.093901 Aug 24 03:53:39.609925 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 426/880] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:39 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:40.299433 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:40.300166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:40.306721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.307214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.307671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.308382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.308836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.309266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.447673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:40.456553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-14b4e7c5-4417-497d-aed2-72dc61252c00 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.161115 Aug 24 03:53:40.457119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 427/881] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:40 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:40.632942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:40.633916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:40.641005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.641487 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.641975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.642640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.643088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.713357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:40.721552 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-91175a51-c282-4fa3-9cdf-617fe8087720 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1293 microversion: 2.1 time: 0.092351 Aug 24 03:53:40.722141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 428/882] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:40 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:40.732522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6c30e646-fd51-4efa-98b6-3a647b0d4a0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:40.739217 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c30e646-fd51-4efa-98b6-3a647b0d4a0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:40.739693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c30e646-fd51-4efa-98b6-3a647b0d4a0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:40.740122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c30e646-fd51-4efa-98b6-3a647b0d4a0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:40.744190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:40.767415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6c30e646-fd51-4efa-98b6-3a647b0d4a0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Going to try to stop instance {{(pid=127736) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:53:40.878680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ce6a3722-5d8f-400e-bafa-f2e4c5f5c8c1 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "POST /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.966548 Aug 24 03:53:40.879280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 455/883] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:53:38 2022] POST /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530/os-volume_attachments => generated 194 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:41.011706 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6c30e646-fd51-4efa-98b6-3a647b0d4a0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action" status: 202 len: 0 microversion: 2.1 time: 0.283016 Aug 24 03:53:41.012324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 429/884] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:53:40 2022] POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:53:41.021449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:41.022228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:41.028531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.029017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.029663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.030308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.030804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.031327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.174835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.185035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9144367c-4138-40de-b236-bdc1eb03d52c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.167521 Aug 24 03:53:41.187712 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 456/885] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:41 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:41.480650 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:41.481345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:41.488489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.488979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.489416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.490142 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.490687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.491114 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.633288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.641994 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a4b326c0-5ace-449f-b935-5dac51205c79 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.166042 Aug 24 03:53:41.642617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 430/886] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:41 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:41.743479 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:41.744050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:41.750525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.751072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.751521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.752235 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:41.752700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:41.752700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:41.819398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:41.828572 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4836952a-838d-416c-a518-8d112fc34a44 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1301 microversion: 2.1 time: 0.089120 Aug 24 03:53:41.829352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 457/887] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:41 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:42.207415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.208029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.211338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:42.214804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.215532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.215778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.217057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.221759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.221759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.363789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:42.371520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c0eedca9-de7f-4c37-b1c0-e1e3a36dc957 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.168182 Aug 24 03:53:42.372088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 431/888] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:42.663192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.664415 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.671730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.672214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.672658 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.673357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.673814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.674267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.817825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:42.827378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1cfb9588-5e49-4a28-92f9-92559111a33d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.168028 Aug 24 03:53:42.828082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 458/889] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:42.851368 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:42.852173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:42.859985 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.860475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.861011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:42.861726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:42.862252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:42.862633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.008410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:43.017246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6e8fe5d9-bf72-47ce-ab41-05e73e2df894 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.170182 Aug 24 03:53:43.030404 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 432/890] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:42 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:43.392992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:43.393834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:43.400103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.400519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.401012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.401699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.402161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.402592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.551992 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:43.560382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d7d667e6-df52-4be5-9a15-8d7f7d5f0793 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.171855 Aug 24 03:53:43.574251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 459/891] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:43 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:43.851835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:43.852618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:43.861794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.862377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.862811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:43.863520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:43.863967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:43.864504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.008054 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-5c22de88-632c-40fa-a114-48be34a76931 req-aafaa025-f052-4cd0-a867-671b9fab5813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0", "tag": "52ceb037-d4c2-446a-9fdf-5965123e4948"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:44.012033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:44.021364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e587f6cf-9388-4ad3-b4ea-5863d4ba2476 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.175416 Aug 24 03:53:44.022049 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 433/892] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:43 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:44.023265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-5c22de88-632c-40fa-a114-48be34a76931 req-aafaa025-f052-4cd0-a867-671b9fab5813 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.023819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-5c22de88-632c-40fa-a114-48be34a76931 req-aafaa025-f052-4cd0-a867-671b9fab5813 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.024322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-5c22de88-632c-40fa-a114-48be34a76931 req-aafaa025-f052-4cd0-a867-671b9fab5813 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.037962 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-5c22de88-632c-40fa-a114-48be34a76931 req-aafaa025-f052-4cd0-a867-671b9fab5813 service nova] Creating event network-changed:52ceb037-d4c2-446a-9fdf-5965123e4948 for instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 on hv-cinder-85425 Aug 24 03:53:44.045557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-5c22de88-632c-40fa-a114-48be34a76931 req-aafaa025-f052-4cd0-a867-671b9fab5813 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039145 Aug 24 03:53:44.045557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 460/893] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:53:44.045837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:44.047306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:44.053264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.053751 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.054220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.054931 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.055388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.055821 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.203952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:44.211648 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dbe860ec-ebfd-4f65-9cac-530f0ebacbf4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.170714 Aug 24 03:53:44.212228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 434/894] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:44 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:44.582798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:44.583412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:44.589925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.590581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.591023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.591751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:44.592238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:44.592660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:44.731902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:44.740444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bff6e24b-d6ca-4356-a6f0-e90deab96d75 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.161981 Aug 24 03:53:44.741034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 461/895] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:44 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:45.048707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:45.049333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:45.056175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.056663 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.057134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.057835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.058327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.058803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.205291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.213606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5dccea58-86c4-4b5d-95f7-ec319af37970 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.169757 Aug 24 03:53:45.214214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 435/896] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:45 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:45.234122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:45.234784 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:45.241834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.242406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.242888 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.243663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.244157 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.244626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.381396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.389770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-79d3b86a-1be8-49dd-b415-66c9d9e5988e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.160537 Aug 24 03:53:45.390462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 462/897] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:45 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:45.762264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:45.762879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:45.769628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.770128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.770604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.771308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:45.771766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:45.772191 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:45.916778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:45.927678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5475c086-ed66-4405-96be-ca316ff24bda tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.169173 Aug 24 03:53:45.928249 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 436/898] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:45 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:46.238697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.239887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.248287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.248925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.249478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.250572 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.251202 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.251766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.390601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:46.398733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9c468e8-7731-48d9-8823-57db35e442ab tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.165170 Aug 24 03:53:46.399291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 463/899] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:46.416652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.417263 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.424186 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.424670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.425102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.425797 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.426296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.426719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.564731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:46.572671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cd613a23-a742-4f12-9dfb-dcc98755235f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.165700 Aug 24 03:53:46.573258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 437/900] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:46.952002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:46.952646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:46.958897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.959381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.959822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:46.960520 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:46.960976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:46.961433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.099552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:47.108740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1845ae07-9cf7-421b-82a0-e0483083fcf0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.160959 Aug 24 03:53:47.109401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 464/901] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:46 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:47.421133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:47.421805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:47.429022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.429517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.429947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.430705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.431160 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.431584 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.581136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:47.594715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:47.595297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b397dee0-ee66-446d-b788-0b499f284b53 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1737 microversion: 2.1 time: 0.178766 Aug 24 03:53:47.595436 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:47.595896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 438/902] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:47 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:47.598017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:47.602891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.604862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.604862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.604862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:47.605191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:47.605797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:47.752163 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:47.760186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5ff6b815-0948-46d1-8714-6341a2720742 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.170403 Aug 24 03:53:47.760780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 465/903] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:47 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:48.130341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.130957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.136986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.137454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.137956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.138626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.139685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.140287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.199246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:48.223436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=10 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:48.287930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.296055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bdb76c1d-1e91-4488-a386-40b76b06f0c4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.169856 Aug 24 03:53:48.296744 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 439/904] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:48 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:48.618501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.619126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.621100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:48.627579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.628072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.628518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.629230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.629693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.630124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.765031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.768527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:48.773748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-29a87e9f-e1f2-49d5-ad93-5193483e9731 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1717 microversion: 2.1 time: 0.159275 Aug 24 03:53:48.774351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 466/905] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:48 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:48.781211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.781834 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.788673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.789159 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.789596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.790333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.790789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.791216 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.911669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:48.912923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:48.919942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.921169 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.921858 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.922599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:48.923048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:48.923470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:48.945304 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:48.953773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6ed809f0-d5bc-463a-8b2d-755a71f5b79b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.176352 Aug 24 03:53:48.954406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 440/906] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:48 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:49.010026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] HTTP exception thrown: Cannot 'detach_volume' instance 611ffff0-163e-4c5f-83be-b31e72dd599c while it is in vm_state rescued Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Request method failure captured: Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments/d9ed9db6-f354-425b-8272-25df40874cee HTTP/1.1 Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NBKNOnFAmhnImen3ftkidIYzhnWWS3R5xmbQpe7uE64h86W3lRVv8AC6uNhe9l9Tykcb76ZAMkfSQYBC3RL9PI2DSc5plFFVwccoxR1K0uo4yrMy9mCrpwU4Fdz0hHYu20gZojP9A4Cw_CM1aF0PpU4z70GRwr4kWgZVBJyn_xHc Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:53:49.011707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 0772f8b4306f4e239f075f7b1c13790f Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:53:49.013244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Cannot 'detach_volume' instance 611ffff0-163e-4c5f-83be-b31e72dd599c while it is in vm_state rescued Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'server_id': '611ffff0-163e-4c5f-83be-b31e72dd599c', 'id': 'd9ed9db6-f354-425b-8272-25df40874cee'} Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:53:49.014063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 611ffff0-163e-4c5f-83be-b31e72dd599c while it is in vm_state rescued Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 611ffff0-163e-4c5f-83be-b31e72dd599c while it is in vm_state rescued Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:53:49.015790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Returning 409 to user: Cannot 'detach_volume' instance 611ffff0-163e-4c5f-83be-b31e72dd599c while it is in vm_state rescued {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:53:49.017004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6bb854e5-ccc6-4dec-8f13-c7b10edf9ae5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments/d9ed9db6-f354-425b-8272-25df40874cee" status: 409 len: 152 microversion: 2.1 time: 0.106118 Aug 24 03:53:49.017004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 467/907] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:53:48 2022] DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments/d9ed9db6-f354-425b-8272-25df40874cee => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:53:49.022667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:49.023208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.029318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.030443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.030887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.034288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.034288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.034288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.251026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-77058251-09a5-4495-8578-17ae896e7d9e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "POST /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/action" status: 202 len: 0 microversion: 2.1 time: 0.232129 Aug 24 03:53:49.251668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 441/908] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:53:49 2022] POST /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:53:49.260407 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.261032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.270672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.271167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.271610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.272325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.272781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.275510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.318424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.319308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.326043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.327134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.327685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.328396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.328853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.329283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.457363 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:49.465904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8c43ee45-0966-4dbd-992d-45c325a758a7 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.209643 Aug 24 03:53:49.466431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 468/909] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:49.501958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:49.509748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5f617fbd-0200-443d-999b-6b1850477279 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.195894 Aug 24 03:53:49.510332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 442/910] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:49.975769 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:49.976376 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:49.983085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.985568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.985568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:49.985568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:49.986070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:49.986529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.123659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.132335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9ddc2fb8-8cb0-43e8-9483-f33cdba3058c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.160286 Aug 24 03:53:50.132903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 469/911] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:49 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:50.488915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:50.489600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:50.496193 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.496682 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.497230 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.497938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.498419 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.498845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.531542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:50.532252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:50.539233 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.539726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.544357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.544357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:50.544357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:50.544357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:50.700796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.710276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-77e5e33d-8c03-4490-a44d-97edc336a6cc tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.182538 Aug 24 03:53:50.711103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 470/912] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:50 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:50.787143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:50.790714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:50.795811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1064cfcd-bf22-460d-85df-e571f89a039f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.310907 Aug 24 03:53:50.796383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 443/913] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:50 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:51.154614 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.155335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.162398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.162887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.163326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.164030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.164484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.165040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.302923 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.311001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e62947a1-1bde-4e89-8689-31568d610664 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.160222 Aug 24 03:53:51.311588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 471/914] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:51.732637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.733197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.740361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.740881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.741323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.742072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.742553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.743064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.821255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:51.822068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:51.829581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.833995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.833995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.833995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:51.833995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:51.834660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:51.919768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.928778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b6e54445-1dc9-4b42-a538-23b05558ea40 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.200448 Aug 24 03:53:51.929102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 444/915] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:51.990195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:51.998721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-50fb75ec-8cbe-4544-8127-c9ed25634ac4 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.181683 Aug 24 03:53:51.999293 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 472/916] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:51 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:52.334408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:52.334937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:52.341175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.341654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.342092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.342815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.343264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.344544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.482783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:52.491068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-07537fbd-de3c-40b2-b876-837cf4cc7e9f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.162999 Aug 24 03:53:52.491635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 445/917] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:52 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:52.950470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:52.951280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:52.959108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.959606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.960177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:52.960889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:52.961579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:52.962015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.020943 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:53.021612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:53.029161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.029658 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.030099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.030922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.031449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.031935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.173556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:53.182287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-236655e2-5c0a-4fb7-a2a5-f21ae5e6d2e1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.235768 Aug 24 03:53:53.196711 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 473/918] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:52 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:53.210285 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:53.219542 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a47f5c56-58c2-4e4e-9f39-174776302ccc tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.202560 Aug 24 03:53:53.220109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 446/919] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:53 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:53.513165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:53.513677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:53.520706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.522917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.522917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.522917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:53.523252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:53.523397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:53.666080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:53.676399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-13352642-d6fd-46e4-8868-fdfbe967343a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.167149 Aug 24 03:53:53.686196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 474/920] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:53 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:54.205246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:54.205852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:54.212428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.212918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.213361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.214074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.214560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.214998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.244862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:54.245599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:54.256174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.256778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.257225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.257944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.258433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.258864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.413583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:54.422262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-00332bf0-adec-49a6-8b97-5a95d986381b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.221366 Aug 24 03:53:54.422842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 447/921] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:54 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:54.439107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:54.447396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-926c1c67-d06e-4334-9c15-97cb83ded48b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.209223 Aug 24 03:53:54.447966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 475/922] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:54 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:54.697666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:54.698255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:54.704947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.705707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.705916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.706662 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:54.707121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:54.707586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:54.846839 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:54.854600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9731128e-53bf-4f21-9c40-688391602e3b tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.160994 Aug 24 03:53:54.855172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 448/923] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:54 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:55.443855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:55.444486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:55.451268 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.451756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.452194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.453225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.453690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.454117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.469321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:55.469884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:55.476377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.476855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.477300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.478006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.478508 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.478937 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.666014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:55.670245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:55.674618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-64895090-f7fa-4cac-90e0-b67f35cd7fe2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.234464 Aug 24 03:53:55.675134 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 476/924] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:55 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:55.679616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3492562e-0db7-4421-9a18-81c710e7d5ee tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.214465 Aug 24 03:53:55.680183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 449/925] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:55 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:55.875993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:55.876583 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:55.882646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.883125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.883592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:55.884286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:55.884742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:55.885165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.028096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:56.036512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d77243c5-13f5-487a-98ee-a0452ea219d6 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.164348 Aug 24 03:53:56.037091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 477/926] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:55 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:56.697019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:56.697543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:56.701672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:56.702320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:56.704566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.705055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.705489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.706216 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.706670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.707094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.709527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.710002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.710476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:56.711170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:56.711616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:56.712037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.158820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:57.166037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:57.169269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8aaf64d6-d2e7-45a1-b044-d478f99008e6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.477018 Aug 24 03:53:57.175011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-228042d0-0e6c-4fb1-9885-3dc007bdf17d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.477311 Aug 24 03:53:57.183344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 478/927] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:56 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:57.183344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:57.183344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:57.183724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 450/928] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:56 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:57.188514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.189249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.189960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.190971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:57.191434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:57.193512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:57.329196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:57.336999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f5098874-cd5f-4cd7-895d-bf7454442c10 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.160044 Aug 24 03:53:57.337561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 479/929] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:57 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:58.190415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:58.191008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:58.197778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.198192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:58.198661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.198779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.198893 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:58.199413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.199867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.200300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.205986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.206513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.206955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.207668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.208132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.208564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.404543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:58.408321 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:58.414491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-67a5ac83-cbfd-4146-b26b-e03b1cc414c2 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.227865 Aug 24 03:53:58.415178 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 451/930] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:58 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:58.416688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c64470bd-e98e-4092-a96c-1ab820bea02d tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.222307 Aug 24 03:53:58.421586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:58.421762 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 480/931] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:58 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:58.422619 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:58.429221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.429715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.430144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.430859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:58.431310 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:58.431729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:58.564643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:58.572276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e5782155-be9a-4fe6-a8fa-c928a73680a1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.155802 Aug 24 03:53:58.572833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 452/932] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:58 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:59.438527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:59.448175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:59.448330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:59.448330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:59.448874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.448874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.448874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.448874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.449184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.449184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.449343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.449699 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.450143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.450883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.451338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.451772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.716176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.719675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.727716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e71c21b0-6d36-4b34-829c-b46a5a750b50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1678 microversion: 2.1 time: 0.290405 Aug 24 03:53:59.728555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 453/933] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:59 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1678 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:53:59.733822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:53:59.734769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:53:59.736109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-738fda50-4a46-4f61-a428-5678ec488473 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1725 microversion: 2.1 time: 0.301984 Aug 24 03:53:59.745127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 481/934] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:59 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:59.751346 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.751954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.752461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.753314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.753841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.754396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:53:59.917043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:53:59.927572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2ad832ce-4f0e-48b9-b0f3-c5b7f54e9b9c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.197653 Aug 24 03:53:59.928704 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 454/935] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:53:59 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:53:59.980321 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-6b7a160c-9b6b-4d46-8c6e-51662b9e7598 req-fd9fbfca-f657-44fd-93a4-cf9fbc0de7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0", "name": "network-vif-plugged", "status": "completed", "tag": "52ceb037-d4c2-446a-9fdf-5965123e4948"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:53:59.992176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-6b7a160c-9b6b-4d46-8c6e-51662b9e7598 req-fd9fbfca-f657-44fd-93a4-cf9fbc0de7be service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:53:59.992654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-6b7a160c-9b6b-4d46-8c6e-51662b9e7598 req-fd9fbfca-f657-44fd-93a4-cf9fbc0de7be service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:53:59.997719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-6b7a160c-9b6b-4d46-8c6e-51662b9e7598 req-fd9fbfca-f657-44fd-93a4-cf9fbc0de7be service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.004892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-6b7a160c-9b6b-4d46-8c6e-51662b9e7598 req-fd9fbfca-f657-44fd-93a4-cf9fbc0de7be service nova] Creating event network-vif-plugged:52ceb037-d4c2-446a-9fdf-5965123e4948 for instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 on hv-cinder-85425 Aug 24 03:54:00.009900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-6b7a160c-9b6b-4d46-8c6e-51662b9e7598 req-fd9fbfca-f657-44fd-93a4-cf9fbc0de7be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035335 Aug 24 03:54:00.010547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 482/936] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:00.755880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.756522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.757913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.758653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.763171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.763658 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.764090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.764764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.764952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.765409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.765519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.765921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.766142 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.766861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.767324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.767753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.976803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:00.983401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:00.985398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-10d0cf6f-30a7-4063-9e44-5851e678139c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1655 microversion: 2.1 time: 0.236392 Aug 24 03:54:00.986053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 455/937] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1655 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:00.990596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:00.991206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:00.991433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2877d0f9-abda-4d72-a6d9-57e44d6d7602 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1731 microversion: 2.1 time: 0.238253 Aug 24 03:54:00.992178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 483/938] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:00.997150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.997639 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.998073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:00.998798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:00.999248 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:00.999678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.005807 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-939ca385-b388-410b-a400-d82934cbf7f6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:01.012555 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-939ca385-b388-410b-a400-d82934cbf7f6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.013048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-939ca385-b388-410b-a400-d82934cbf7f6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.013491 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-939ca385-b388-410b-a400-d82934cbf7f6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.017313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:01.037183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-939ca385-b388-410b-a400-d82934cbf7f6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Going to try to start instance {{(pid=127737) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:54:01.142394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:01.150513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-27d0cd1b-6f12-402c-929f-aa9e1f864246 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.163469 Aug 24 03:54:01.151078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 456/939] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:00 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:01.156266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:01.156873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:01.162683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.163167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.163600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.164397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.164789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.165216 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.245741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1072db00-84cb-4851-a0cc-9c1803bfcd05 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093589 Aug 24 03:54:01.246361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 457/940] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:54:01 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:01.265744 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-939ca385-b388-410b-a400-d82934cbf7f6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action" status: 202 len: 0 microversion: 2.1 time: 0.262741 Aug 24 03:54:01.266682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 484/941] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 03:54:01 2022] POST /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:54:01.274959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:01.275621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:01.282562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.283045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.283544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.284247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:01.284728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:01.285119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:01.525750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:01.534894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f490e32c-8f42-416d-9000-430cc40370b1 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.263773 Aug 24 03:54:01.535522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 458/942] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:01 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:02.173818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:02.174681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:02.181542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.182050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.182673 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.183703 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.184173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.184604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.390570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:02.402279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b134bcd4-14fe-4625-9ba8-fb62b8fde4a7 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.232794 Aug 24 03:54:02.403762 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 485/943] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:02 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:02.481807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-063c47db-79ea-4fb8-945f-5db520493e9e req-7b400315-886d-4864-b3c1-f7f2a2fbe36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611ffff0-163e-4c5f-83be-b31e72dd599c", "tag": "0d9a4992-1d7c-44c3-aefb-900ad718be1f"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:02.502074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-063c47db-79ea-4fb8-945f-5db520493e9e req-7b400315-886d-4864-b3c1-f7f2a2fbe36c service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.503011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-063c47db-79ea-4fb8-945f-5db520493e9e req-7b400315-886d-4864-b3c1-f7f2a2fbe36c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.503840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-063c47db-79ea-4fb8-945f-5db520493e9e req-7b400315-886d-4864-b3c1-f7f2a2fbe36c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.527442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-063c47db-79ea-4fb8-945f-5db520493e9e req-7b400315-886d-4864-b3c1-f7f2a2fbe36c service nova] Creating event network-changed:0d9a4992-1d7c-44c3-aefb-900ad718be1f for instance 611ffff0-163e-4c5f-83be-b31e72dd599c on hv-cinder-85425 Aug 24 03:54:02.536328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-063c47db-79ea-4fb8-945f-5db520493e9e req-7b400315-886d-4864-b3c1-f7f2a2fbe36c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146401 Aug 24 03:54:02.536328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 459/944] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:02.558022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:02.559344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:02.566781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.570509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.571066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.572044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:02.573101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:02.573778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:02.736636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:02.744470 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-85f1f0f8-d153-44df-bd36-d37c6654399c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.191442 Aug 24 03:54:02.757555 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 486/945] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:02 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:03.426535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:03.427241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:03.433430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.433923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.434403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.435129 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.435648 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.436022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.571770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:03.579859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2677442c-7dd8-4499-8bfb-5f7210ea9587 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.158606 Aug 24 03:54:03.580421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 460/946] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:03 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:03.765208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:03.766010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:03.772338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.772820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.773257 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.773951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:03.774430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:03.774854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:03.911330 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:03.919757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-948d0fd8-6eea-4dbf-8578-80ac9494f588 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.158673 Aug 24 03:54:03.920338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 487/947] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:03 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:04.551383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-d5a9bcd5-438e-4ac3-be9a-3fa6d4bee67a req-779f2cb2-5dbe-4d13-b3b7-ece1dd1ff044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "611ffff0-163e-4c5f-83be-b31e72dd599c", "tag": "0d9a4992-1d7c-44c3-aefb-900ad718be1f"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:04.561772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d5a9bcd5-438e-4ac3-be9a-3fa6d4bee67a req-779f2cb2-5dbe-4d13-b3b7-ece1dd1ff044 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.562295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d5a9bcd5-438e-4ac3-be9a-3fa6d4bee67a req-779f2cb2-5dbe-4d13-b3b7-ece1dd1ff044 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.562734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d5a9bcd5-438e-4ac3-be9a-3fa6d4bee67a req-779f2cb2-5dbe-4d13-b3b7-ece1dd1ff044 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.577793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-d5a9bcd5-438e-4ac3-be9a-3fa6d4bee67a req-779f2cb2-5dbe-4d13-b3b7-ece1dd1ff044 service nova] Creating event network-changed:0d9a4992-1d7c-44c3-aefb-900ad718be1f for instance 611ffff0-163e-4c5f-83be-b31e72dd599c on hv-cinder-85425 Aug 24 03:54:04.583149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-d5a9bcd5-438e-4ac3-be9a-3fa6d4bee67a req-779f2cb2-5dbe-4d13-b3b7-ece1dd1ff044 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036527 Aug 24 03:54:04.583864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 461/948] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:04.602203 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:04.603019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:04.615851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.615851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.615851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.615851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.616210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.616210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.753309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:04.761663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b31c629c-a16b-4598-85a8-4fe8f332b304 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.164551 Aug 24 03:54:04.762283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 488/949] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:04 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:04.941660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:04.942482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:04.953601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.953601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.953601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.953601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:04.954070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:04.954070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:04.956291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:05.120233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.128036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2bb31b61-9591-4ac4-b4c2-b72641f73e0a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.190702 Aug 24 03:54:05.128602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 462/950] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:04 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:05.783995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:05.784810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:05.791771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.792272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.792714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.793434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:05.793893 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:05.794362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:05.941006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:05.948584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4dbaefe0-931b-4e6e-a257-6d65395ddaea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.169589 Aug 24 03:54:05.949259 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 489/951] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:05 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:06.148916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.149653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.157720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.158519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.159162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.159875 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.160361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.160790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.319473 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:06.327446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9e072371-3103-4747-993a-34d949165284 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.182223 Aug 24 03:54:06.328162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 463/952] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:06.970436 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:06.970983 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:06.977444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.977928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.978396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:06.979113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:06.979548 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:06.979974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.112451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.120513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0be4cc7f-ba0a-4c27-a36a-147dae10b5ea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1367 microversion: 2.1 time: 0.154116 Aug 24 03:54:07.121092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 490/953] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:06 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:07.352940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:07.352940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:07.355643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.356132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.356573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.357530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:07.357986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:07.359002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:07.490897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:07.498764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e6a36d2b-4f9e-4a5e-95a8-b251020c467c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.154268 Aug 24 03:54:07.499968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 464/954] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:07 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.141594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.142340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.149246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.149733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.150190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.151877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.151877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.151877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.380992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.381755 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.388303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.398136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.398136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.398136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.398136 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.399154 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.465002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.473142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-daaba0e9-913a-4f21-86b6-a26158f31f00 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1558 microversion: 2.1 time: 0.336012 Aug 24 03:54:08.473829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 491/955] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1558 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.496108 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'services' on Instance uuid 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:08.496347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.496645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.503363 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.504066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.504501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.505184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.505635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.506051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.588968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a90dc39c-3c7d-4869-9aac-d2b75138c06e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096749 Aug 24 03:54:08.589632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 492/956] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:54:08.594478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:08.595091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:08.601251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.601743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.602233 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.602918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:08.603375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:08.603804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:08.748596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:08.756987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-50b5e7c3-6c48-4c71-af2f-96d44abf4021 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1664 microversion: 2.1 time: 0.166229 Aug 24 03:54:08.757554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 493/957] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:08 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:08.772857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b24e76b5-69b7-4034-80a1-e8bd62a96e6c tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530/os-volume_attachments/05f82214-118d-4b42-9ab2-66a0d9f31ba8" status: 202 len: 0 microversion: 2.1 time: 0.396946 Aug 24 03:54:08.773460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 465/958] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:54:08 2022] DELETE /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530/os-volume_attachments/05f82214-118d-4b42-9ab2-66a0d9f31ba8 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:54:09.778770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-1117d81d-73ed-46f3-b2eb-64e2cfcfeb7a req-12fe45e8-bdb1-43bf-8766-3f8e68c1a0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0", "tag": "52ceb037-d4c2-446a-9fdf-5965123e4948"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:09.779528 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:09.780295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:09.787642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.788138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.788586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.789308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.789764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.790107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1117d81d-73ed-46f3-b2eb-64e2cfcfeb7a req-12fe45e8-bdb1-43bf-8766-3f8e68c1a0e0 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:09.790255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.790601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1117d81d-73ed-46f3-b2eb-64e2cfcfeb7a req-12fe45e8-bdb1-43bf-8766-3f8e68c1a0e0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:09.791030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1117d81d-73ed-46f3-b2eb-64e2cfcfeb7a req-12fe45e8-bdb1-43bf-8766-3f8e68c1a0e0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:09.804507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-1117d81d-73ed-46f3-b2eb-64e2cfcfeb7a req-12fe45e8-bdb1-43bf-8766-3f8e68c1a0e0 service nova] Creating event network-changed:52ceb037-d4c2-446a-9fdf-5965123e4948 for instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 on hv-cinder-85425 Aug 24 03:54:09.809994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-1117d81d-73ed-46f3-b2eb-64e2cfcfeb7a req-12fe45e8-bdb1-43bf-8766-3f8e68c1a0e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100887 Aug 24 03:54:09.811093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 494/959] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:09.954850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:09.962830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-28079bb3-9b54-44de-ad97-e2d3a62b601e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1668 microversion: 2.1 time: 0.188208 Aug 24 03:54:09.963481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 466/960] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:09 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1668 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:12.025140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.025726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.032846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.033324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.033873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.034586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.035061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.035481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.065309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:12.378223 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-986358f0-5265-4ed3-b0e8-6633aa64c906 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 204 len: 0 microversion: 2.1 time: 0.357479 Aug 24 03:54:12.378851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 495/961] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:54:12 2022] DELETE /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:12.387174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:12.387817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:12.395240 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.395731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.396165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.396860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:12.397417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:12.397853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:12.533691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:12.541615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e4763706-e7f4-4971-a783-1526f56e2d11 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1515 microversion: 2.1 time: 0.158310 Aug 24 03:54:12.546258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 467/962] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:12 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:13.563972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:13.564678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:13.571331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.571988 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.572420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.573153 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:13.573603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:13.574028 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:13.713383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:13.722148 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-720c6099-ba8f-4356-a08d-604e364236a0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1515 microversion: 2.1 time: 0.162655 Aug 24 03:54:13.722741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 496/963] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:13 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:14.744802 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:14.745383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:14.747763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=73 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:14.753412 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.753881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.754353 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.755082 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:14.755524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:14.755947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:14.896039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:14.904707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d501b833-a411-40e2-8350-d701b0f48eb7 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1515 microversion: 2.1 time: 0.164004 Aug 24 03:54:14.905345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 468/964] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:14 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:15.926599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:15.927204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:15.934214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.934742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.935254 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:15.936024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:15.937047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:15.937831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.088217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:16.097022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-60ad0e8f-3bc1-49bd-91e8-a8e021c14caf tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1515 microversion: 2.1 time: 0.174364 Aug 24 03:54:16.097682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 497/965] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:15 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:16.323252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-dfe7f6a1-502c-46bd-bc36-871b863ef466 req-c2763a3c-23fc-4f7a-ab25-763b8ff6f6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530", "name": "network-vif-deleted", "tag": "ace9097f-c5f9-481f-9643-da2a1bac6edb"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:16.339873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-dfe7f6a1-502c-46bd-bc36-871b863ef466 req-c2763a3c-23fc-4f7a-ab25-763b8ff6f6db service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:16.340720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-dfe7f6a1-502c-46bd-bc36-871b863ef466 req-c2763a3c-23fc-4f7a-ab25-763b8ff6f6db service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:16.341532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-dfe7f6a1-502c-46bd-bc36-871b863ef466 req-c2763a3c-23fc-4f7a-ab25-763b8ff6f6db service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:16.360920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-dfe7f6a1-502c-46bd-bc36-871b863ef466 req-c2763a3c-23fc-4f7a-ab25-763b8ff6f6db service nova] Creating event network-vif-deleted:ace9097f-c5f9-481f-9643-da2a1bac6edb for instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 on hv-cinder-85425 Aug 24 03:54:16.367835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-dfe7f6a1-502c-46bd-bc36-871b863ef466 req-c2763a3c-23fc-4f7a-ab25-763b8ff6f6db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051269 Aug 24 03:54:16.368586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 469/966] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:17.124303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:17.125180 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:17.131591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.136760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.136760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.136760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.136760 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.137356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.166704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:17.167289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:17.167728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:17.168229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lazy-loading 'fault' on Instance uuid 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:17.210100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5247fd6c30794dc48f60a827d5837674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f646fe435e4aa2954af01070537ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:17.213734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:17.219062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3d6d1a91-cac9-4b41-956d-7b87664eb9d0 tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 200 len: 1309 microversion: 2.1 time: 0.101306 Aug 24 03:54:17.219621 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 498/967] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:17 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:54:18.241771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:18.242505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] [instance: 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:18.249527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.250121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.250592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.251298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:18.251776 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:18.252199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:18.266519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] HTTP exception thrown: Instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 could not be found. Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Request method failure captured: Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 HTTP/1.1 Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ_9f1Nw6NWig4_tvXqBGkAaG4P0GhGooBlSoHQPaKS6UKRiGUNru9uVB3zGTkyNZa-TquXH8OuYRr0TCGrH44d_GA8rxm-_Ol9n8Gng8spp-2eK3kt7qcCgO3Bf4cLpHoBKBTMAg3Y45uB_3Ia1y73mXiBvmbGEgdsx_UPH_SyaLCE Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 46f646fe435e4aa2954af01070537ae4 Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1462751987 Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:54:18.268268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46f646fe435e4aa2954af01070537ae4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/46f646fe435e4aa2954af01070537ae4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/46f646fe435e4aa2954af01070537ae4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_46f646fe435e4aa2954af01070537ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-VolumesSnapshotTestJSON-1462751987 Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 46f646fe435e4aa2954af01070537ae4 Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1462751987 Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-VolumesSnapshotTestJSON-1462751987-project Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 5247fd6c30794dc48f60a827d5837674 Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-VolumesSnapshotTestJSON-1462751987-project Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 could not be found. Aug 24 03:54:18.269691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530'} Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 could not be found. Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:18.270549 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 could not be found. Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 could not be found. Aug 24 03:54:18.271846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:54:18.273128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] Returning 404 to user: Instance 0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:18.273128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-86459a86-9941-498c-b967-e6f703187a6b tempest-VolumesSnapshotTestJSON-1462751987 tempest-VolumesSnapshotTestJSON-1462751987-project] 10.222.0.65 "GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530" status: 404 len: 111 microversion: 2.1 time: 0.032780 Aug 24 03:54:18.273128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 470/968] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:54:18 2022] GET /compute/v2.1/servers/0ec19ee4-cb4b-4fdd-9147-b0c6dbaab530 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:54:36.256540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:36.355439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.355943 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.363368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.363854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.367411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.367411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.367411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.367411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.396113 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2a1f2a4d-395d-49fe-a18c-274cf7cafb2b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments/0881a278-5bc1-49ba-932a-bf175adf06cd" status: 200 len: 194 microversion: 2.20 time: 0.144996 Aug 24 03:54:36.396704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 499/969] 10.222.0.65 () {60 vars in 1454 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments/0881a278-5bc1-49ba-932a-bf175adf06cd => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:54:36.466494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.467824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.469894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=5 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:36.470570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:36.475384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.475859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.476292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.477086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.477541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.477986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.559868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'services' on Instance uuid 67941698-f5a1-496f-a571-64116228b0d3 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:36.860895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cf157eff-a03d-412d-bf64-6437f1b87b37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments/0881a278-5bc1-49ba-932a-bf175adf06cd" status: 202 len: 0 microversion: 2.20 time: 0.398165 Aug 24 03:54:36.861427 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 471/970] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 24 03:54:36 2022] DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments/0881a278-5bc1-49ba-932a-bf175adf06cd => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:54:36.869989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:36.872253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:36.878864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.879361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.879804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.880513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:36.880991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:36.881405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:36.911289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b66f579b-f4ac-4909-88a8-099f128fb023 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045346 Aug 24 03:54:36.911835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 500/971] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 03:54:36 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:54:37.925063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:37.928130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:37.935848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.936396 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.936833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.939002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:37.939967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:37.940437 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:37.974968 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c998d81d-c253-43e4-abb9-3673c4015746 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054691 Aug 24 03:54:37.975524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 472/972] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 03:54:37 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:54:38.988506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:38.990710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:38.997162 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.997640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:38.998756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:38.999539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:38.999997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:39.000425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:39.031489 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-caf4f237-0566-40a7-a7e6-62e8360cc41b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046942 Aug 24 03:54:39.032052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 501/973] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 03:54:38 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:54:40.044029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.046238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.052720 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.053209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.053634 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.054372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.054829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.055259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.090506 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fac976e1-a117-47a4-9763-677c59855bb0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050279 Aug 24 03:54:40.091092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 473/974] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:54:40.163903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.164501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.171549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.172038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.172480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.173179 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.173636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.174066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.202915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:54:40.543323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-caccb2cd-20b6-434e-8e96-1382776ab3ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 204 len: 0 microversion: 2.20 time: 0.383109 Aug 24 03:54:40.543915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 502/975] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 03:54:40 2022] DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:54:40.552959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:40.553562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:40.559989 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.560553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.561045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.561767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:40.562238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:40.562664 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:40.697391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.705924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.707561 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:40.708722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c3783ee6-d9dd-42bb-8df0-80d1af6394c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.159758 Aug 24 03:54:40.709277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 474/976] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:40 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:41.734262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:41.734894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:41.741594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.742071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.742539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.743232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:41.743681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:41.744103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:41.877529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.886164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.887748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:41.889108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-02089047-093b-40ae-aa61-8c770f438b32 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.160459 Aug 24 03:54:41.889789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 503/977] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:41 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:42.912543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:42.913169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:42.919581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.920341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.920724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:42.921417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:42.921871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:42.922347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:43.052936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.061897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.063441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:43.064674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f245f0aa-c6c0-4718-b31a-91c599de2a5c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.156066 Aug 24 03:54:43.065214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 475/978] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:42 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:44.088506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:44.090522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:44.095998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.096495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.096925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.097625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:44.098080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:44.098543 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:44.232875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.241941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.245280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:44.245280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f8c510c3-bf15-4ee9-8803-0f014309bb0e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1721 microversion: 2.20 time: 0.160331 Aug 24 03:54:44.245488 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 504/979] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:44 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:45.047579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-ddf9e81a-ce78-4aa1-bc9b-9c7853d5a9e9 req-c2b8a6db-746c-4f28-ae6f-893bbd6983b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67941698-f5a1-496f-a571-64116228b0d3", "name": "network-vif-deleted", "tag": "1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:45.065115 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ddf9e81a-ce78-4aa1-bc9b-9c7853d5a9e9 req-c2b8a6db-746c-4f28-ae6f-893bbd6983b6 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.065851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ddf9e81a-ce78-4aa1-bc9b-9c7853d5a9e9 req-c2b8a6db-746c-4f28-ae6f-893bbd6983b6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.066547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-ddf9e81a-ce78-4aa1-bc9b-9c7853d5a9e9 req-c2b8a6db-746c-4f28-ae6f-893bbd6983b6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.080187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-ddf9e81a-ce78-4aa1-bc9b-9c7853d5a9e9 req-c2b8a6db-746c-4f28-ae6f-893bbd6983b6 service nova] Creating event network-vif-deleted:1e5a33dc-8fa3-42d1-8f9b-ac919fe77b5c for instance 67941698-f5a1-496f-a571-64116228b0d3 on hv-cinder-85425 Aug 24 03:54:45.085667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-ddf9e81a-ce78-4aa1-bc9b-9c7853d5a9e9 req-c2b8a6db-746c-4f28-ae6f-893bbd6983b6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041902 Aug 24 03:54:45.086380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 476/980] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:45.269911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:45.270584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:45.282532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.283054 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.283500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.284248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:45.286066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:45.286833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:45.387444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.398127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.400079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:45.401583 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a6df43b2-dba9-4af4-a7f8-7941aeea4bb7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1366 microversion: 2.20 time: 0.135614 Aug 24 03:54:45.418450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 505/981] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:45 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:46.426834 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:46.427572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:46.433833 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.434359 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.434905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.436177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.436670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.437078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.470219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:46.470747 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:46.471324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:46.471975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'fault' on Instance uuid 67941698-f5a1-496f-a571-64116228b0d3 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:54:46.518616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.527341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.529747 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:46.531167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c46dc487-edc7-4af4-a3a6-eff865ae5ebf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 200 len: 1371 microversion: 2.20 time: 0.109272 Aug 24 03:54:46.531956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 477/982] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:46 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:47.561308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.561933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:47.568935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.569414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.569845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.570566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:47.571014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:47.571435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:47.586404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] HTTP exception thrown: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Request method failure captured: Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 HTTP/1.1 Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-OIdheRs2NR6Ch26upr7AzS45jfpMPeHxH7Fb6acilsJ-lGdzC47d-Pn9Da2tTgEt1bhTEH2TPjqDJTq9vyTL6zfrYTQOx9vNQDtUnxaJH9qBVUQK8wCSbAYk5C2MJxEZ_HcMbO_d68L9eK86eGtctQJXtCUaZvUfjBGY4YNMze9E Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:54:47.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: bd8d967d9ecb410ea47e130ac3c8b4a6 Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:54:47.592245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '67941698-f5a1-496f-a571-64116228b0d3'} Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:54:47.593230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:54:47.594747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:54:47.596101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Returning 404 to user: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:54:47.596101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3d285cbd-b6ef-4dcd-85e4-44137168a8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 404 len: 111 microversion: 2.20 time: 0.032916 Aug 24 03:54:47.596101 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 506/983] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:47 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:54:47.599318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d78c3d9c-ff15-407d-ba61-d946b12e78bd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '.version_select at 0x7f6c13678c10>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:47.679360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d78c3d9c-ff15-407d-ba61-d946b12e78bd tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918565050" status: 204 len: 0 microversion: 2.20 time: 0.083894 Aug 24 03:54:47.679866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 478/984] 10.222.0.65 () {60 vars in 1259 bytes} [Wed Aug 24 03:54:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918565050 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:54:48.721789 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-02f27e78-86ab-490e-b837-1450537a69f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'create', calling method: .version_select at 0x7f6c136f55e0>, body: {"keypair": {"name": "tempest-keypair-1753318992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi6Ja6OUI5PCyjCY0BMyH853uLk8dRWedwCEH/GhnitBDFwspQpMobUQcFNGF432usU9HgpDfQd5pNVj4An4aG0ds9MTwAmD9lVQ+TdWWk4V0H/mo2FceRZT9jI5BSjFA=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:48.738875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-02f27e78-86ab-490e-b837-1450537a69f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:48.742674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-02f27e78-86ab-490e-b837-1450537a69f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for user bd8d967d9ecb410ea47e130ac3c8b4a6 and project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:48.893315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-02f27e78-86ab-490e-b837-1450537a69f1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.175475 Aug 24 03:54:48.893902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 507/985] 10.222.0.65 () {62 vars in 1200 bytes} [Wed Aug 24 03:54:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 03:54:51.522007 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-316234018", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4327a85-5abe-481f-bda3-6ed236459f01"}], "security_groups": [{"name": "tempest-securitygroup--169372528"}], "key_name": "tempest-keypair-1753318992", "user_data": "}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:51.633821 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] validate_networks() for [('c4327a85-5abe-481f-bda3-6ed236459f01', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:54:52.036853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:54:52.037431 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:54:52.037889 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:54:52.038329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:54:52.045239 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:54:52.048423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.048903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.049335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.050050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:52.050520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:52.050941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:52.069411 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:54:52.073582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Getting quotas for user bd8d967d9ecb410ea47e130ac3c8b4a6 and project ffc635aa12d14aa0b2880abe4e4f8f2f. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:54:52.085692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:54:52.088158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:54:52.240703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5848585f-f049-4255-960e-4236f8baa8f9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.723436 Aug 24 03:54:52.241243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 479/986] 10.222.0.65 () {62 vars in 1188 bytes} [Wed Aug 24 03:54:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 03:54:52.253609 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c3a2b249-0b99-46aa-9348-a24139b8cfef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:52.254246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c3a2b249-0b99-46aa-9348-a24139b8cfef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:52.309525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c3a2b249-0b99-46aa-9348-a24139b8cfef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.318280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c3a2b249-0b99-46aa-9348-a24139b8cfef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.319866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c3a2b249-0b99-46aa-9348-a24139b8cfef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:52.321079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c3a2b249-0b99-46aa-9348-a24139b8cfef tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1281 microversion: 2.20 time: 0.072088 Aug 24 03:54:52.321665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 508/987] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:52 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:53.344755 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:53.345505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:53.351938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.352420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.352860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.353678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:53.354138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:53.354601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:53.424252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.433188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.434750 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:53.435861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4ef931f8-7a37-4100-b7be-a059fd706c6b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1285 microversion: 2.20 time: 0.096454 Aug 24 03:54:53.436422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 480/988] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:53 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:54.464613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:54.465229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:54.472323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.472818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.473280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.473988 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:54.474479 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:54.474932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:54.541144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.549584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.551100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:54.552202 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-810dc859-d95c-4d79-8453-e12fe9197122 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1333 microversion: 2.20 time: 0.091843 Aug 24 03:54:54.552748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 509/989] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:54 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:55.579008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:55.580678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:55.597477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.598266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.598715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.599473 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:55.599939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:55.600361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:55.745162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.753853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.755417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:55.756567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-93ac974e-ea3d-465c-9377-3c3e9596dd16 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.183666 Aug 24 03:54:55.757145 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 481/990] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:55 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:56.512047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-1804ef74-1cf7-4444-9971-31e1613a4a0a req-696fb768-55a0-4c87-809e-b0face485332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:54:56.522584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1804ef74-1cf7-4444-9971-31e1613a4a0a req-696fb768-55a0-4c87-809e-b0face485332 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.523063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1804ef74-1cf7-4444-9971-31e1613a4a0a req-696fb768-55a0-4c87-809e-b0face485332 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.523500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-1804ef74-1cf7-4444-9971-31e1613a4a0a req-696fb768-55a0-4c87-809e-b0face485332 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.535624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-1804ef74-1cf7-4444-9971-31e1613a4a0a req-696fb768-55a0-4c87-809e-b0face485332 service nova] Creating event network-changed:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:54:56.540626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-1804ef74-1cf7-4444-9971-31e1613a4a0a req-696fb768-55a0-4c87-809e-b0face485332 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032357 Aug 24 03:54:56.542273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 510/991] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:54:56.780139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:56.781586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:56.788329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.788846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.790837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.790837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:56.790837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:56.790837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:56.926846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.937118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.938757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:56.939885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0b6b4c03-455d-40ea-a6ec-1c1844ad0335 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.164240 Aug 24 03:54:56.940446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 482/992] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:56 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:57.963440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:57.964150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:57.970448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.970929 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.971368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:57.972061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:57.972519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:57.972956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:58.105915 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.114532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.116183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:58.117291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a66e2db1-629a-47f9-bbf9-e239d22c93ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.158848 Aug 24 03:54:58.117850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 511/993] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:57 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:54:59.141060 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:54:59.141674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:54:59.148197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.148683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.149122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.149822 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:54:59.150312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:54:59.150738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:54:59.291430 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.300245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.301771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:54:59.303015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-06c64718-7a5e-4f1e-9f6d-df786f83eaf5 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.166718 Aug 24 03:54:59.303571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 483/994] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:54:59 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:00.326343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:00.326892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:00.333589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.334076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.334579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.335327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:00.335819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:00.336251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:00.481938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.491012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.493478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:00.494697 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a80234a9-e0cc-4779-8ce6-5807f1a40f35 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.172429 Aug 24 03:55:00.495250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 512/995] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:00 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:01.517385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:01.519288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:01.524234 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.524963 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.525393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.526091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:01.526564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:01.526986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:01.663009 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.672520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.674034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:01.675184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d14a9d19-0b0f-4e58-bc1c-c5d1d8827dc9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.162226 Aug 24 03:55:01.675741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 484/996] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:01 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:02.381485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=6 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:02.566737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-a2413f23-2def-44c5-a182-b3e1e7cef5ff req-4317564d-c412-4661-bdf8-be070bab456a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "name": "network-vif-plugged", "status": "completed", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:02.577093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a2413f23-2def-44c5-a182-b3e1e7cef5ff req-4317564d-c412-4661-bdf8-be070bab456a service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.577592 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a2413f23-2def-44c5-a182-b3e1e7cef5ff req-4317564d-c412-4661-bdf8-be070bab456a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.578026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a2413f23-2def-44c5-a182-b3e1e7cef5ff req-4317564d-c412-4661-bdf8-be070bab456a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.588774 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-a2413f23-2def-44c5-a182-b3e1e7cef5ff req-4317564d-c412-4661-bdf8-be070bab456a service nova] Creating event network-vif-plugged:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:55:02.594337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-a2413f23-2def-44c5-a182-b3e1e7cef5ff req-4317564d-c412-4661-bdf8-be070bab456a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217807 Aug 24 03:55:02.595109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 513/997] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:02.698324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:02.699071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:02.702789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:02.703466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=6 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:02.707370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.707865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.708301 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.709010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:02.709468 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:02.709901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:02.844424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.853360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.854942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:02.856956 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dfafbe69-ce0e-4a24-a09f-4223353804e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.162653 Aug 24 03:55:02.857537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 485/998] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:02 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:03.687074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.687656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.693973 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.694528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.694970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.695688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.696147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.696636 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.789872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'services' on Instance uuid 611ffff0-163e-4c5f-83be-b31e72dd599c {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:03.881672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:03.882433 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:03.890056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.890575 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.891014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:03.891741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:03.892192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:03.892654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.021792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-951b62fb-8657-4715-acd0-f26110ea9123 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments/d9ed9db6-f354-425b-8272-25df40874cee" status: 202 len: 0 microversion: 2.1 time: 0.340097 Aug 24 03:55:04.022425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 514/999] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:55:03 2022] DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments/d9ed9db6-f354-425b-8272-25df40874cee => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:04.032093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:04.034431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:04.035519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.040895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.041379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.041813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.042552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:04.043003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:04.043518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:04.044116 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.045632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:04.046870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-04b55ff8-0461-48d0-9b46-b53336060155 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.169767 Aug 24 03:55:04.048696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 486/1000] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:03 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:04.076420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-004c98fd-bddb-4a28-8f51-37a8c5daee34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048494 Aug 24 03:55:04.076982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 515/1001] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:04 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:05.071715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.072409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.080411 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.081017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.081593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.082459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.083031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.083572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.089109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:05.092097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:05.098638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.099123 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.099568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.100273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:05.100737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:05.101172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:05.131436 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-73a56be0-eae6-4dc9-aa63-310e219b430a tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046253 Aug 24 03:55:05.132015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 516/1002] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:05.221167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.230100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.232022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:05.233247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cf95cf29-af38-4ee0-93fa-0ee51aeeef37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1406 microversion: 2.20 time: 0.166363 Aug 24 03:55:05.233806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 487/1003] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:05 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:55:06.143941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.146142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.152847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.153917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.154475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.155178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.155642 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.156146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.160214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:06.188053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-189fb842-72ce-4e96-9710-441dfdfc76f8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048085 Aug 24 03:55:06.188822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 517/1004] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:06.255764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.256519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.263562 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.264053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.265507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.265507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.265701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.266132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.398726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.402113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:06.408395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.409978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:06.411181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e2802217-e8d1-4ef1-878e-2424f58ca62f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1597 microversion: 2.20 time: 0.159477 Aug 24 03:55:06.414560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 488/1005] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:06.434089 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:06.434787 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:06.436577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:06.441594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.444656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.444656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.444656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:06.444656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:06.445026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:06.526776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-464e17b0-b646-421d-aa2a-377205c8c6c9 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096974 Aug 24 03:55:06.527407 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 518/1006] 10.222.0.65 () {60 vars in 1316 bytes} [Wed Aug 24 03:55:06 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:07.201079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.203345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.205303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:07.213488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.213488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.213488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.213488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.213942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.213942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.245479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4b79d603-0eb2-4c27-a0ef-c121107587fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048625 Aug 24 03:55:07.246065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 489/1007] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:55:07.362394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.362978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.374714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.375578 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.376356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.377570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.378416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.379195 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.421142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:07.613891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-0ef7b61c-c142-4a20-8cf1-d3df2442703e req-8a871fed-5cda-405a-91a7-01186544db8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:07.625772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-0ef7b61c-c142-4a20-8cf1-d3df2442703e req-8a871fed-5cda-405a-91a7-01186544db8d service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.628043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-0ef7b61c-c142-4a20-8cf1-d3df2442703e req-8a871fed-5cda-405a-91a7-01186544db8d service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.628043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-0ef7b61c-c142-4a20-8cf1-d3df2442703e req-8a871fed-5cda-405a-91a7-01186544db8d service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.643765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-0ef7b61c-c142-4a20-8cf1-d3df2442703e req-8a871fed-5cda-405a-91a7-01186544db8d service nova] Creating event network-changed:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:55:07.653628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-0ef7b61c-c142-4a20-8cf1-d3df2442703e req-8a871fed-5cda-405a-91a7-01186544db8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042312 Aug 24 03:55:07.653945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 490/1008] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:07.777551 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8c08d033-fd12-4ce5-8736-6953c786229c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 204 len: 0 microversion: 2.1 time: 0.421298 Aug 24 03:55:07.778796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 519/1009] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:07 2022] DELETE /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:07.788526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:07.789573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:07.797906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.798865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.800496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.801565 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:07.802205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:07.802793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:07.954653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:07.962911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4bfab720-a46e-473e-abae-c2327d0ee59f tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.179280 Aug 24 03:55:07.963500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 491/1010] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:07 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:08.738848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.741088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.748339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.748815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.749248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.749932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.750447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.750867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.782667 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ea307022-0622-421b-a353-f9616899a73f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048314 Aug 24 03:55:08.783250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 520/1011] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:55:08.846335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.846855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.853071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.853551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.853988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.854703 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.855156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.855675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.881820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:08.986222 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:08.986834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:08.992953 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.993922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.994390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:08.995073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:08.995527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:08.995951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.134279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.142541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-68242419-4c5f-408b-9371-51ba221a39a5 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.160425 Aug 24 03:55:09.143125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 521/1012] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:08 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:09.177126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8486c950-ecdd-4f75-925a-841d2ef73b4b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 204 len: 0 microversion: 2.1 time: 0.334694 Aug 24 03:55:09.177710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 492/1013] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:08 2022] DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:09.186224 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:09.186834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:09.192914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.193399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.193841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.194561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:09.195021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:09.197875 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:09.329986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:09.342384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-01b48d44-b8bd-4d8c-8d54-4ab906aa0a79 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1674 microversion: 2.1 time: 0.160202 Aug 24 03:55:09.342982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 522/1014] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:09 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:10.164593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.165292 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.171940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.172427 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.172870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.173608 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.174060 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.174519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.324212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.333197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-480667a1-f70f-446a-8e80-935c6d6aee64 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.172838 Aug 24 03:55:10.333762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 493/1015] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:10.362910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:10.363523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:10.369934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.370454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.370895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.371581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:10.372039 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:10.372464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:10.506750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:10.514804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-14d3c132-d59a-4498-afef-2b1b093a60c9 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1674 microversion: 2.1 time: 0.155762 Aug 24 03:55:10.515380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 523/1016] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:10 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.354935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.355544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.362919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.363405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.363844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.364543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.364998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.365429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.500469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.508729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-861c0191-6c63-4a1c-abca-0434586e0b63 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.157709 Aug 24 03:55:11.509296 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 494/1017] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:11.536247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:11.536864 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:11.543237 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.544325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.544837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.545616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:11.546440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:11.547184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:11.682548 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:11.691079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4d633217-1c72-4eab-aa4b-236fae749f56 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1674 microversion: 2.1 time: 0.158616 Aug 24 03:55:11.691669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 524/1018] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:11 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.532258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.532863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.539500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.539982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.540415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.541107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.541559 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.541975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.684257 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:12.692552 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6091fbd7-ef76-48a6-9e8d-93017c589581 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.164742 Aug 24 03:55:12.693114 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 495/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:12.712156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:12.712825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:12.720017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.720500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.720940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.721759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:12.722087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:12.722568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:12.853446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:12.862200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-84cc9301-2ca2-4c47-9d4c-ee501072b549 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1674 microversion: 2.1 time: 0.153930 Aug 24 03:55:12.862767 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 525/1020] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:12 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.715232 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.716972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.722970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.723455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.723894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.724592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.725075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.725506 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.859582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:13.867375 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e2c23595-20dd-4674-904c-a73dfa231b5c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.156117 Aug 24 03:55:13.867939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 496/1021] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:13.883458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:13.884061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:13.891106 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.891635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.892069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:13.892781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:13.893261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:13.893685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.027289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:14.035994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f446978c-d54b-43a9-b5b0-3665e4925cf3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1674 microversion: 2.1 time: 0.156659 Aug 24 03:55:14.036556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 526/1022] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:13 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:14.890050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:14.890626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:14.898238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.898840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.899378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:14.900169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:14.900707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:14.901226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.057559 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:15.058208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:15.066023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.066773 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.067537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.068314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.068841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.069326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.220030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.228547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-90aa2bc8-7086-408a-8ff7-e9d83fefe2fb tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1691 microversion: 2.1 time: 0.342626 Aug 24 03:55:15.229447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 497/1023] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:14 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1691 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:15.318871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:15.329009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-48e217c0-d7aa-42f2-a2fd-d77c05c85c5b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1674 microversion: 2.1 time: 0.275151 Aug 24 03:55:15.330420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 527/1024] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:15 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:15.793199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-1de58052-654c-4538-beaf-6fbbaee717ed req-b65f6ce8-9b72-40f6-baa1-65d5093f7f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd163bb-cead-4664-bfcc-59aa1b1f920f", "name": "network-vif-deleted", "tag": "86a4494f-cdb8-4299-a2f3-8e9d161bb68e"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:15.804792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-1de58052-654c-4538-beaf-6fbbaee717ed req-b65f6ce8-9b72-40f6-baa1-65d5093f7f54 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.805338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-1de58052-654c-4538-beaf-6fbbaee717ed req-b65f6ce8-9b72-40f6-baa1-65d5093f7f54 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.806117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-1de58052-654c-4538-beaf-6fbbaee717ed req-b65f6ce8-9b72-40f6-baa1-65d5093f7f54 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:15.824520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-1de58052-654c-4538-beaf-6fbbaee717ed req-b65f6ce8-9b72-40f6-baa1-65d5093f7f54 service nova] Creating event network-vif-deleted:86a4494f-cdb8-4299-a2f3-8e9d161bb68e for instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f on hv-cinder-85425 Aug 24 03:55:15.830927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-1de58052-654c-4538-beaf-6fbbaee717ed req-b65f6ce8-9b72-40f6-baa1-65d5093f7f54 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044076 Aug 24 03:55:15.836593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 498/1025] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:15.973964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-793ae6aa-ef21-4df2-9d81-6d382ca207b6 req-2b0e8ac9-1cb1-45f4-8d9f-21e100342814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "611ffff0-163e-4c5f-83be-b31e72dd599c", "name": "network-vif-deleted", "tag": "0d9a4992-1d7c-44c3-aefb-900ad718be1f"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:15.994938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-793ae6aa-ef21-4df2-9d81-6d382ca207b6 req-2b0e8ac9-1cb1-45f4-8d9f-21e100342814 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:15.995411 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-793ae6aa-ef21-4df2-9d81-6d382ca207b6 req-2b0e8ac9-1cb1-45f4-8d9f-21e100342814 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:15.995830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-793ae6aa-ef21-4df2-9d81-6d382ca207b6 req-2b0e8ac9-1cb1-45f4-8d9f-21e100342814 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.047570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-793ae6aa-ef21-4df2-9d81-6d382ca207b6 req-2b0e8ac9-1cb1-45f4-8d9f-21e100342814 service nova] Creating event network-vif-deleted:0d9a4992-1d7c-44c3-aefb-900ad718be1f for instance 611ffff0-163e-4c5f-83be-b31e72dd599c on hv-cinder-85425 Aug 24 03:55:16.047570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-793ae6aa-ef21-4df2-9d81-6d382ca207b6 req-2b0e8ac9-1cb1-45f4-8d9f-21e100342814 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060767 Aug 24 03:55:16.047570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 528/1026] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:16.252744 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.253460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.262694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.263877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.264738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.265659 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.266425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.267065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.352612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:16.354135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:16.362749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.363699 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.364393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.365349 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.366050 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.366855 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.367215 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.377321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-389cb2f6-8eb5-4da2-8b63-2ca3008b677e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1331 microversion: 2.1 time: 0.128674 Aug 24 03:55:16.378281 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 499/1027] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:16.428228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:16.428783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:16.429228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:16.429698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lazy-loading 'fault' on Instance uuid 2dd163bb-cead-4664-bfcc-59aa1b1f920f {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:16.484264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:16.493088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ff18ac98-ca63-4aa2-8ce9-6f437ba4118b tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 200 len: 1327 microversion: 2.1 time: 0.145084 Aug 24 03:55:16.493687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 529/1028] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:16 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:17.402572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.404258 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.413221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.413221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.413483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.414215 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.414754 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.415181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.453317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.453875 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.454389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.455056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'fault' on Instance uuid 611ffff0-163e-4c5f-83be-b31e72dd599c {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:17.480218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:55:17.481065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 03:55:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:55:17.502126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:17.511723 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0f3bb211-ac75-44ff-aa58-d641edd983a6 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 200 len: 1336 microversion: 2.1 time: 0.112370 Aug 24 03:55:17.520424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 500/1029] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:17.523604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.523604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.525068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.525566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.526011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.526945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.527607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.528777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.544503 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] HTTP exception thrown: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Request method failure captured: Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f HTTP/1.1 Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-QEssHyxlavpg4Vtpb3bDRqSz1WTZHTEFm6noE_ovGozwXPvIhKIoOWUM1P-qbxoHuRVSW3u_eJqyHJfuhD6ilAWjo56SWywDhoRAxbZmMlio6fqkVQsRtyruIdaL4gv3GbtbCH8ljaWrHVu-EAS6W6kGG5n9Ufe3rBa5rc94u7dA Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:55:17.546194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 7f4991f9c6ca4fc99f756f75f9460808 Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:55:17.547823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '2dd163bb-cead-4664-bfcc-59aa1b1f920f'} Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:17.549020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:55:17.550587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:17.552073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Returning 404 to user: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:17.552073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f5932cc2-566f-4e44-a59a-f494dcd51962 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 404 len: 111 microversion: 2.1 time: 0.036197 Aug 24 03:55:17.552073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 530/1030] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:17.556714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7cd46121-6e52-47f9-9b14-374451d3a220 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '.version_select at 0x7f6c136955e0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.654890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:17.655305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:17.658068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7cd46121-6e52-47f9-9b14-374451d3a220 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559024651" status: 202 len: 0 microversion: 2.1 time: 0.105127 Aug 24 03:55:17.658693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 501/1031] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 03:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559024651 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:17.661995 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.662976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.663200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.663914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:17.664374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:17.664824 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:17.690561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a53b8948-df73-4849-bb27-9a908cd47234 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/ips" status: 200 len: 150 microversion: 2.1 time: 0.040478 Aug 24 03:55:17.691132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 531/1032] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:55:17 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:18.484735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-eb4134b9-d4d7-4c03-97da-1d9e998deb9a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: .version_select at 0x7f6c135fd670>, body: {"keypair": {"name": "tempest-keypair-280845503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7PTUB0uyT0n3l2nI0r/LBLvez092nDece8u+IojZM1vcT3xIlh27UlzZauhyKOh1t0sN5iYhpAeNE9Mgjn7JD2y1OW/ButfRC6cN9NhG5TTBabTEAeUNe1X4vJS5FYQA=="}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:18.502796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-eb4134b9-d4d7-4c03-97da-1d9e998deb9a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:18.506634 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-eb4134b9-d4d7-4c03-97da-1d9e998deb9a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for user 7f4991f9c6ca4fc99f756f75f9460808 and project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:18.533499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.534136 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 611ffff0-163e-4c5f-83be-b31e72dd599c] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:18.540708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.541295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.541718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.542532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:18.546181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:18.546181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:18.558187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] HTTP exception thrown: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c could not be found. Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Request method failure captured: Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c HTTP/1.1 Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NBKNOnFAmhnImen3ftkidIYzhnWWS3R5xmbQpe7uE64h86W3lRVv8AC6uNhe9l9Tykcb76ZAMkfSQYBC3RL9PI2DSc5plFFVwccoxR1K0uo4yrMy9mCrpwU4Fdz0hHYu20gZojP9A4Cw_CM1aF0PpU4z70GRwr4kWgZVBJyn_xHc Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:55:18.559753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 0772f8b4306f4e239f075f7b1c13790f Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c could not be found. Aug 24 03:55:18.561540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '611ffff0-163e-4c5f-83be-b31e72dd599c'} Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c could not be found. Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:18.562451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c could not be found. Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c could not be found. Aug 24 03:55:18.563696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:18.564826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Returning 404 to user: Instance 611ffff0-163e-4c5f-83be-b31e72dd599c could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:18.564826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3781d65a-5774-4dfb-b250-451bc78c8b66 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c" status: 404 len: 111 microversion: 2.1 time: 0.031482 Aug 24 03:55:18.564826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 532/1033] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:18 2022] GET /compute/v2.1/servers/611ffff0-163e-4c5f-83be-b31e72dd599c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:55:18.569886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-69ea289a-72bb-4fc1-a42d-bbd07c02657e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '.version_select at 0x7f6c136ce280>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:18.601291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-eb4134b9-d4d7-4c03-97da-1d9e998deb9a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121334 Aug 24 03:55:18.601909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 502/1034] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:55:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:18.758990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-69ea289a-72bb-4fc1-a42d-bbd07c02657e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564381336" status: 202 len: 0 microversion: 2.1 time: 0.192765 Aug 24 03:55:18.764921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 533/1035] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 24 03:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564381336 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:19.455849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:19.458405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:19.465015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.466878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.467128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:19.467857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:19.468313 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:19.468765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:20.380777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ed0a4904-bbc4-4ddb-a6e1-dd4fb5cde0cd tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929280 Aug 24 03:55:20.381558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 503/1036] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:55:19 2022] POST /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:21.463642 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-244177902", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06073011-9116-4dec-b966-b8baeee066ed"}], "security_groups": [{"name": "tempest-securitygroup--1584301870"}], "key_name": "tempest-keypair-280845503", "user_data": "}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:21.575185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] validate_networks() for [('06073011-9116-4dec-b966-b8baeee066ed', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:22.059294 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:22.059734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:22.060197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:22.060606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:22.061017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:22.069730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.070248 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.070688 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.071462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.071918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.072346 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.089498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:22.094435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Getting quotas for user 7f4991f9c6ca4fc99f756f75f9460808 and project dbaf4ab3fd764ce88e7af0dbc3e6601e. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:22.105466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:22.108502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:22.229524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bde666a9-5943-4826-b5fe-cedd8cf66a8a tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770420 Aug 24 03:55:22.230174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 534/1037] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:55:22.242758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ff94dedd-ac75-4854-95d3-1ca91362cb31 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.243458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ff94dedd-ac75-4854-95d3-1ca91362cb31 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.303344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ff94dedd-ac75-4854-95d3-1ca91362cb31 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:22.311448 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ff94dedd-ac75-4854-95d3-1ca91362cb31 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1236 microversion: 2.1 time: 0.073371 Aug 24 03:55:22.311952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 504/1038] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:22 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:22.622537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:22.627674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:22.631444 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.632002 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.632590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.633340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:22.633826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:22.634276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:22.662718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:22.694011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:23.046128 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3b056d0a-80bd-41ff-b086-72899019d600 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "DELETE /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 204 len: 0 microversion: 2.1 time: 0.428452 Aug 24 03:55:23.046745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 535/1039] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:22 2022] DELETE /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:23.054950 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.055558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.063709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.064195 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.064631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.065326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.065772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.066225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.202959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.211837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6c114164-6df4-4e43-a821-93235e62107b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.160661 Aug 24 03:55:23.212461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 505/1040] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:23.333698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:23.334539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:23.342044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.342558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.342998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.343749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:23.344229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:23.344659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:23.408925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:23.416828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3e597e10-a4bd-4085-a361-2453f798f72e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1240 microversion: 2.1 time: 0.087925 Aug 24 03:55:23.417390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 536/1041] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:23 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:24.233339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.233948 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.241435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.241976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.242449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.243158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.243636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.244066 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.264931 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:24.391173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.399039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a87b120d-f721-42ae-a255-fb4c0f18c9f9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1509 microversion: 2.1 time: 0.170074 Aug 24 03:55:24.399616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 506/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:24.437869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:24.442739 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:24.449076 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.450696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.451178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.451905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.452377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.452815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.469414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-f5b02ecf-a4f9-4f85-876e-6a0b6c04906e req-a80aad2e-946e-4578-93cc-b54f3052ec9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d0e70d-85fe-4bda-affc-1087593bb9a9", "name": "network-vif-deleted", "tag": "41041e86-75dd-4f31-b356-afb7225b7f42"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:24.482193 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f5b02ecf-a4f9-4f85-876e-6a0b6c04906e req-a80aad2e-946e-4578-93cc-b54f3052ec9f service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:24.482828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f5b02ecf-a4f9-4f85-876e-6a0b6c04906e req-a80aad2e-946e-4578-93cc-b54f3052ec9f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:24.483271 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f5b02ecf-a4f9-4f85-876e-6a0b6c04906e req-a80aad2e-946e-4578-93cc-b54f3052ec9f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:24.494978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-f5b02ecf-a4f9-4f85-876e-6a0b6c04906e req-a80aad2e-946e-4578-93cc-b54f3052ec9f service nova] Creating event network-vif-deleted:41041e86-75dd-4f31-b356-afb7225b7f42 for instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 on hv-cinder-85425 Aug 24 03:55:24.501274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-f5b02ecf-a4f9-4f85-876e-6a0b6c04906e req-a80aad2e-946e-4578-93cc-b54f3052ec9f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035952 Aug 24 03:55:24.502194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 507/1043] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:24.527839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:24.536277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0f75830b-2e7a-49af-bb7b-71da4190897e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1288 microversion: 2.1 time: 0.103011 Aug 24 03:55:24.536862 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 537/1044] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:24 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:25.422500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.423196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.430183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.430680 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.431106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.431790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.432312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.432760 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.466764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.467247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.467718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.468253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'fault' on Instance uuid 92d0e70d-85fe-4bda-affc-1087593bb9a9 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:25.531419 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.539455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a802bdee-db8e-4fa3-9bf5-ea793d402f0e tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1312 microversion: 2.1 time: 0.122769 Aug 24 03:55:25.540021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 508/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:25.556951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:25.557557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:25.564474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.564951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.565385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.566071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:25.566549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:25.566971 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:25.633824 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:25.642178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f84ea826-eb2a-4166-baac-6f1ed800cb2f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1306 microversion: 2.1 time: 0.089062 Aug 24 03:55:25.642723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 538/1046] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:25 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:26.565380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:26.565380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:26.571274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.571754 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.572184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.573086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.573717 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.574696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.617852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.618715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.619179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.619642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'fault' on Instance uuid 92d0e70d-85fe-4bda-affc-1087593bb9a9 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:26.664980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:26.666326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:26.666876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.674977 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f9bd3379-78ab-44eb-b043-23da77b55ce9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 200 len: 1312 microversion: 2.1 time: 0.117755 Aug 24 03:55:26.676318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 509/1047] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:26 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:26.677989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.678539 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.678946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.679656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:26.680105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:26.680528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:26.905731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:26.915260 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2b6eb95e-f02d-4568-bf53-e9819004f094 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.254112 Aug 24 03:55:26.915766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 539/1048] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:26 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:27.576357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-5ea8b34a-08d9-49c3-8468-262f963bcc84 req-1f6eef02-a26a-4b42-9fd2-d150f75b7ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b025db2-3af4-4945-89af-46d94652c12e", "tag": "4769f633-b48b-4b72-b906-80999f75554f"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:27.586367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5ea8b34a-08d9-49c3-8468-262f963bcc84 req-1f6eef02-a26a-4b42-9fd2-d150f75b7ea2 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.586880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5ea8b34a-08d9-49c3-8468-262f963bcc84 req-1f6eef02-a26a-4b42-9fd2-d150f75b7ea2 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.587314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5ea8b34a-08d9-49c3-8468-262f963bcc84 req-1f6eef02-a26a-4b42-9fd2-d150f75b7ea2 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.598584 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-5ea8b34a-08d9-49c3-8468-262f963bcc84 req-1f6eef02-a26a-4b42-9fd2-d150f75b7ea2 service nova] Creating event network-changed:4769f633-b48b-4b72-b906-80999f75554f for instance 9b025db2-3af4-4945-89af-46d94652c12e on hv-cinder-85425 Aug 24 03:55:27.603523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-5ea8b34a-08d9-49c3-8468-262f963bcc84 req-1f6eef02-a26a-4b42-9fd2-d150f75b7ea2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031631 Aug 24 03:55:27.604316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 510/1049] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:27.697158 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.697768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 92d0e70d-85fe-4bda-affc-1087593bb9a9] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.705118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.705716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.706193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.706911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.707367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.707800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.722000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] HTTP exception thrown: Instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 could not be found. Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Request method failure captured: Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 HTTP/1.1 Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NBKNOnFAmhnImen3ftkidIYzhnWWS3R5xmbQpe7uE64h86W3lRVv8AC6uNhe9l9Tykcb76ZAMkfSQYBC3RL9PI2DSc5plFFVwccoxR1K0uo4yrMy9mCrpwU4Fdz0hHYu20gZojP9A4Cw_CM1aF0PpU4z70GRwr4kWgZVBJyn_xHc Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:55:27.723736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 0772f8b4306f4e239f075f7b1c13790f Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 could not be found. Aug 24 03:55:27.725285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '92d0e70d-85fe-4bda-affc-1087593bb9a9'} Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 could not be found. Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:27.726264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 could not be found. Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 could not be found. Aug 24 03:55:27.727759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:27.729197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Returning 404 to user: Instance 92d0e70d-85fe-4bda-affc-1087593bb9a9 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:27.729197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-58434e85-f245-4ee2-b7ec-24eba0b4c223 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9" status: 404 len: 111 microversion: 2.1 time: 0.032078 Aug 24 03:55:27.729197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 540/1050] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/92d0e70d-85fe-4bda-affc-1087593bb9a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:27.734840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.735439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.741738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.742247 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.742701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.743402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.743849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.744300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.771888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:27.941261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:27.942056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:27.948334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.948821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.949287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:27.958416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:27.958416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:27.958416 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.157333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.166454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-62fcf1a7-9fc1-4c3a-ac4b-afa37a48cf11 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.229126 Aug 24 03:55:28.178272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 541/1051] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:27 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:28.193798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-98c7232c-df3a-40cb-a2bd-1a415cf2913c tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 204 len: 0 microversion: 2.1 time: 0.463437 Aug 24 03:55:28.194429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 511/1052] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:27 2022] DELETE /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:28.203669 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:28.204563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:28.212311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.212773 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.213335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.214304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:28.215435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:28.216042 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:28.354186 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:28.363120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-49415009-22b9-41dd-8ba1-ee824f4509e0 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.163970 Aug 24 03:55:28.363765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 542/1053] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:28 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:29.053666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:29.056078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.063500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.063978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.064414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.065103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.065551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.066029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.180666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Invalid volume: volume c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c is already attached to instances: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: POST /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments HTTP/1.1 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 74 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:55:29.182713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {"volumeAttachment": {"volumeId": "c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c"}} Aug 24 03:55:29.184914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Invalid volume: volume c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c is already attached to instances: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'server_id': 'da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0', 'body': {'volumeAttachment': {'volumeId': 'c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c'}}} Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c is already attached to instances: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.185685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c is already attached to instances: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:29.186892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:29.188093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:29.188093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:29.188093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:29.188093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c is already attached to instances: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 Aug 24 03:55:29.188093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:29.190220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 400 to user: Invalid volume: volume c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c is already attached to instances: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:29.190570 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.191184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.191888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7854944d-71ef-43d5-baeb-fff8cadcf424 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142430 Aug 24 03:55:29.192556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 512/1054] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:55:29 2022] POST /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:55:29.198667 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.199191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.200155 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.200876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.201337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.201771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.265752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.266280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.276194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.276194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.276194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.276572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.276721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.277155 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.361999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.368643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'services' on Instance uuid da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:29.374710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-386c8ef8-e341-4184-8250-f44dcf88b147 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.186206 Aug 24 03:55:29.388220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 543/1055] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:29.393338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.394174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.400618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.401458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.402112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.403320 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.404027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.404682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.570228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:29.578754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-41254805-b0e4-4f96-9a4d-bf45bc572fe8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.189194 Aug 24 03:55:29.579328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 544/1056] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:29.630789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7654d1be-ad32-44d3-957e-1c46c27ace96 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments/c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c" status: 202 len: 0 microversion: 2.1 time: 0.369433 Aug 24 03:55:29.631404 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 513/1057] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:55:29 2022] DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments/c8c6ff5d-f189-45ae-8fe3-a60b0b66d01c => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:55:29.640214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:29.642507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:29.649273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.649755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.650218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.650922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:29.651375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:29.651799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:29.683743 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-18d6240e-7951-4715-9d0b-f92db8b18f12 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Aug 24 03:55:29.684184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 545/1058] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:29 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:30.396848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.397555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.404832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.405312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.406949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.407673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.408201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.408642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.546735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.556311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fbeb4363-5209-42c5-80d0-85ad1cff97ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.164099 Aug 24 03:55:30.556888 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 514/1059] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:30.600802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.601418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.608386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.608900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.609306 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.610014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.610503 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.610934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.696508 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:30.698849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:30.706053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.706767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.707361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.708313 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:30.708921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:30.709490 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:30.742298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d6e7e92c-c6b5-41a1-af8e-4200ca0b7c8a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 Aug 24 03:55:30.742872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 515/1060] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:30.752213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:30.760020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-708b6212-ed9a-4fcc-80fb-a390c84fe250 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.163108 Aug 24 03:55:30.760633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 546/1061] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:30 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:31.580443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.581067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.587985 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.588478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.588939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.589774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.590825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.591259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.735054 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.742851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e28acd77-0abf-4a13-bf3f-a22626615d6c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.166419 Aug 24 03:55:31.743414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 516/1062] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:31.755084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.764970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.773094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.773589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.774032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.775012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.775528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.775961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.784429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:31.785041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:31.791156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.791643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.792084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.792892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:31.793398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:31.793826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:31.809506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0f2692cb-ddbc-4ff4-af28-6301a530ca74 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058432 Aug 24 03:55:31.810067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 547/1063] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:31.945360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:31.954289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2729831d-1a09-46c5-9db6-6ef1f8a8b566 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1522 microversion: 2.1 time: 0.173780 Aug 24 03:55:31.955374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 517/1064] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:31 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:32.441063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-75492c88-0c04-41d0-9426-8df48c2f748f req-b5003c16-7748-46d7-88da-037b4a7e57ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c98ae52-9a1c-49c4-bd7a-84247b52a2ac", "name": "network-vif-deleted", "tag": "a6681857-8400-45a1-8c5c-4c531119c8f4"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:32.445810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:32.446498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=6 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:32.452073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-75492c88-0c04-41d0-9426-8df48c2f748f req-b5003c16-7748-46d7-88da-037b4a7e57ac service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.452484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-75492c88-0c04-41d0-9426-8df48c2f748f req-b5003c16-7748-46d7-88da-037b4a7e57ac service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.452906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-75492c88-0c04-41d0-9426-8df48c2f748f req-b5003c16-7748-46d7-88da-037b4a7e57ac service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.463746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-75492c88-0c04-41d0-9426-8df48c2f748f req-b5003c16-7748-46d7-88da-037b4a7e57ac service nova] Creating event network-vif-deleted:a6681857-8400-45a1-8c5c-4c531119c8f4 for instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac on hv-cinder-85425 Aug 24 03:55:32.470725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-75492c88-0c04-41d0-9426-8df48c2f748f req-b5003c16-7748-46d7-88da-037b4a7e57ac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Aug 24 03:55:32.477461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 548/1065] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:32.764394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.765107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.767417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=6 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:32.773083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.773660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.774197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.774982 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.775538 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.776040 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.822522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.824788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.832747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.833243 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.833685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.834463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.834925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.835363 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.868833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3381f2c2-5b1e-494e-9a0a-1f3ba76e2c41 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051499 Aug 24 03:55:32.869399 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 549/1066] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:32.913944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:32.922333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6909dfd7-6ed0-4feb-887d-9f37e0e929ce tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.162179 Aug 24 03:55:32.922925 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 518/1067] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:32.975303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:32.975817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:32.982911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.983397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.983842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:32.984536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:32.984996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:32.985427 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.058486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:33.066497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7a6ce8b9-52d2-4145-93de-d470fe23eda9 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1307 microversion: 2.1 time: 0.095114 Aug 24 03:55:33.067062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 550/1068] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:32 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:33.881055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.883291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.889965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.890476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.890910 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.891603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.892048 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.892469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.921858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b204e179-fa13-4b98-a5ab-cb3c6cb714ba tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044733 Aug 24 03:55:33.922497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 519/1069] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:55:33.944523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.945250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.952266 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.952761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.953201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.953910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.954397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.954854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.986695 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:33.987190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:33.993570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.994063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.994522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:33.995221 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:33.995671 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:33.996724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.022541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:34.059096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.092256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.100001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1543a4e8-e233-474f-aba2-61f92e615f50 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.160086 Aug 24 03:55:34.100568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 551/1070] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:33 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:34.105068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:34.106413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:34.108278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.113073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.113561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.114000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.114729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.115188 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.115620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.135047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.148588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.149118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.149562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.150019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'fault' on Instance uuid 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:34.193288 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.201431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bedc6d71-3c97-4170-b720-cf866460815b tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1312 microversion: 2.1 time: 0.099834 Aug 24 03:55:34.202009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 552/1071] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:34 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:34.270579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:34.343137 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5184f19d-3d53-4a9d-8f8b-9dcbb08814fe tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 204 len: 0 microversion: 2.1 time: 0.359973 Aug 24 03:55:34.343815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 520/1072] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:33 2022] DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:55:34.352580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:34.353424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:34.361496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.361991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.362497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.363220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:34.363680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:34.364110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:34.504846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:34.518542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-94aaae74-773e-4509-a4c8-3f353c504962 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1682 microversion: 2.1 time: 0.169863 Aug 24 03:55:34.519174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 553/1073] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:34 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:35.123500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.124389 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.132158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.132642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.133075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.133775 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.134255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.134686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.223451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.224068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.233115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.233602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.237382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.237382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.237382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.237382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.269486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.269852 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.270316 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.270768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'fault' on Instance uuid 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:35.276708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.284686 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-de4bc383-5820-46a9-a83e-6eed435c4e6f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.166773 Aug 24 03:55:35.285266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 521/1074] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:35.312546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.320174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6e329d4e-51bc-4a86-9a07-4509c5d19b34 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1312 microversion: 2.1 time: 0.100603 Aug 24 03:55:35.320740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 554/1075] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:35.541023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:35.541565 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:35.548726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.549243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.549986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.550589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:35.551048 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:35.551507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:35.687865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:35.695657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c8b4d52c-20a5-450d-aea1-9dddde31a937 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1682 microversion: 2.1 time: 0.159026 Aug 24 03:55:35.696220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 522/1076] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:35 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:36.306309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.306940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.315200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.315702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.316181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.316911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.317374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.317889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.341556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.343001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.351994 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.352793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.353508 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.354479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.366489 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.367348 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.422119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.422933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.423567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.424215 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lazy-loading 'fault' on Instance uuid 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:36.487172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0772f8b4306f4e239f075f7b1c13790f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c993aed86aaf431495a2d1724218fa9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.495311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c15aa928-92a5-4f16-8f91-5a9b55428cb8 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 200 len: 1312 microversion: 2.1 time: 0.158084 Aug 24 03:55:36.495942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 523/1077] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:36.500757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-17ee9899-680a-4713-8b41-70a1bd313c7b req-bf4c8636-0a2d-4e7d-929b-e8a3ce7b21ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b025db2-3af4-4945-89af-46d94652c12e", "name": "network-vif-plugged", "status": "completed", "tag": "4769f633-b48b-4b72-b906-80999f75554f"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:36.511169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-17ee9899-680a-4713-8b41-70a1bd313c7b req-bf4c8636-0a2d-4e7d-929b-e8a3ce7b21ac service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.511571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-17ee9899-680a-4713-8b41-70a1bd313c7b req-bf4c8636-0a2d-4e7d-929b-e8a3ce7b21ac service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.512110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-17ee9899-680a-4713-8b41-70a1bd313c7b req-bf4c8636-0a2d-4e7d-929b-e8a3ce7b21ac service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.514167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.522590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-029269af-0a39-43ba-a902-724d9f5af0ec tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.220162 Aug 24 03:55:36.523174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 555/1078] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:36.524783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-17ee9899-680a-4713-8b41-70a1bd313c7b req-bf4c8636-0a2d-4e7d-929b-e8a3ce7b21ac service nova] Creating event network-vif-plugged:4769f633-b48b-4b72-b906-80999f75554f for instance 9b025db2-3af4-4945-89af-46d94652c12e on hv-cinder-85425 Aug 24 03:55:36.531159 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-17ee9899-680a-4713-8b41-70a1bd313c7b req-bf4c8636-0a2d-4e7d-929b-e8a3ce7b21ac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034055 Aug 24 03:55:36.531778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 524/1079] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:36.716960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:36.717624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:36.723886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.724370 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.724808 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.725510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:36.725965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:36.726417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:36.931990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:36.941362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8c97ea76-770f-4005-8e1e-a6a6d2ccbb28 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1682 microversion: 2.1 time: 0.228853 Aug 24 03:55:36.941945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 556/1080] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:36 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:37.522537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:37.523249 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] [instance: 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.531002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.531276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.531710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.532411 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.533030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.533456 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.545216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:37.550085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.551718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] HTTP exception thrown: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac could not be found. Aug 24 03:55:37.553216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Request method failure captured: Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac HTTP/1.1 Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NBKNOnFAmhnImen3ftkidIYzhnWWS3R5xmbQpe7uE64h86W3lRVv8AC6uNhe9l9Tykcb76ZAMkfSQYBC3RL9PI2DSc5plFFVwccoxR1K0uo4yrMy9mCrpwU4Fdz0hHYu20gZojP9A4Cw_CM1aF0PpU4z70GRwr4kWgZVBJyn_xHc Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:55:37.553618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c993aed86aaf431495a2d1724218fa9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: c993aed86aaf431495a2d1724218fa9b Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275760523 Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 0772f8b4306f4e239f075f7b1c13790f Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275760523-project Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac could not be found. Aug 24 03:55:37.555220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '7c98ae52-9a1c-49c4-bd7a-84247b52a2ac'} Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac could not be found. Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:37.556156 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac could not be found. Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac could not be found. Aug 24 03:55:37.557402 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:55:37.559330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] Returning 404 to user: Instance 7c98ae52-9a1c-49c4-bd7a-84247b52a2ac could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:37.559330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3a336c16-bf33-4466-9b27-ed83f6862f73 tempest-ServerRescueNegativeTestJSON-275760523 tempest-ServerRescueNegativeTestJSON-275760523-project] 10.222.0.65 "GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac" status: 404 len: 111 microversion: 2.1 time: 0.039409 Aug 24 03:55:37.559330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 525/1081] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:37 2022] GET /compute/v2.1/servers/7c98ae52-9a1c-49c4-bd7a-84247b52a2ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:37.560162 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.560991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.561753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.562261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.562694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.807834 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:37.816917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3a8668eb-e2ae-4e1c-8401-b3da36e0e721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.276381 Aug 24 03:55:37.817652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 557/1082] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:37 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:37.921850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-66aa33ca-8f74-4b91-b4bf-87cbc3806f87 req-46a7d5c9-51a2-4e03-adb6-280819433bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0", "name": "network-vif-deleted", "tag": "52ceb037-d4c2-446a-9fdf-5965123e4948"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:37.938850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-66aa33ca-8f74-4b91-b4bf-87cbc3806f87 req-46a7d5c9-51a2-4e03-adb6-280819433bc6 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.939636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-66aa33ca-8f74-4b91-b4bf-87cbc3806f87 req-46a7d5c9-51a2-4e03-adb6-280819433bc6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.940274 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-66aa33ca-8f74-4b91-b4bf-87cbc3806f87 req-46a7d5c9-51a2-4e03-adb6-280819433bc6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.956465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-66aa33ca-8f74-4b91-b4bf-87cbc3806f87 req-46a7d5c9-51a2-4e03-adb6-280819433bc6 service nova] Creating event network-vif-deleted:52ceb037-d4c2-446a-9fdf-5965123e4948 for instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 on hv-cinder-85425 Aug 24 03:55:37.963683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:37.964596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:37.972005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.972589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.973694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.974894 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:37.976094 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:37.976807 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:37.979953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-66aa33ca-8f74-4b91-b4bf-87cbc3806f87 req-46a7d5c9-51a2-4e03-adb6-280819433bc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062453 Aug 24 03:55:37.986294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 526/1083] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:38.065312 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:38.073304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ce9004a4-0fcc-4560-821c-ad46ac26f9d1 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1614 microversion: 2.1 time: 0.113658 Aug 24 03:55:38.074835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 558/1084] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:37 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1614 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:38.840879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:38.841609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:38.858578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.860345 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.861088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:38.862830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:38.863898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:38.864582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.023584 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.034918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-28279e50-3665-4b22-a3da-1e7604ac8151 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1362 microversion: 2.1 time: 0.199038 Aug 24 03:55:39.035527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 527/1085] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:38 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:39.095928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:39.096660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:39.103710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.104292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.104805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.106145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.106700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.107259 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.150404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:39.151527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:39.152463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:39.153482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'fault' on Instance uuid da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:39.212403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:39.221851 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8d495cba-5f00-4c43-8006-2d9ccc57369e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 200 len: 1331 microversion: 2.1 time: 0.129913 Aug 24 03:55:39.222831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 559/1086] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:39 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:40.057667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:40.059530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:40.068451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.069107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.069735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.071558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.072103 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.072927 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.247148 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:40.248051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:40.260988 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.261901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.263853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.267173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.278516 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.284380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.308236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 HTTP/1.1 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:55:40.310886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:55:40.315527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0'} Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:40.316297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:55:40.317580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:40.318765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:40.318765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5888091b-16f4-4046-9339-ce190addfd20 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 404 len: 111 microversion: 2.1 time: 0.069498 Aug 24 03:55:40.318765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 560/1087] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:40 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:40.322354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-712dd7ac-3ab1-4bb5-8eae-c5fcf6dd590f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '.version_select at 0x7f6c137115e0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:40.372601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:40.386462 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3a5a6472-7db8-4503-a787-c1e6f2638ade tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1549 microversion: 2.1 time: 0.333808 Aug 24 03:55:40.390708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 528/1088] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:40 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1549 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:40.428400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-712dd7ac-3ab1-4bb5-8eae-c5fcf6dd590f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706220841" status: 202 len: 0 microversion: 2.1 time: 0.109808 Aug 24 03:55:40.429481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 561/1089] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 03:55:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706220841 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:55:40.431527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:40.432970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:40.448252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.449043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.449850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.451117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:40.451288 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:40.451815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:40.595055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1dcd14c1-713a-46d5-ab26-85d888503aa5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175221 Aug 24 03:55:40.595744 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 529/1090] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:55:40 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:41.401626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-56680721-8bea-4c44-8ffa-1194350a577c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: .version_select at 0x7f6c13767e50>, body: {"keypair": {"name": "tempest-keypair-1476358237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgduALoJngmhjvM3lq6x3S3D4fGea0mq88TtFOaoFOEYSe2UgTcYBG5UJPVwZNWbYvLA9sHdaEl3MsiIg99ypAfzhzCRtNxdJIr4wNUVio3RMEjiNwjSkhqjHFcRMoKDw=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:41.420003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-56680721-8bea-4c44-8ffa-1194350a577c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:41.424205 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-56680721-8bea-4c44-8ffa-1194350a577c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:41.562658 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-56680721-8bea-4c44-8ffa-1194350a577c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164943 Aug 24 03:55:41.563703 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 562/1091] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:55:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:42.299923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-b78552b8-f972-42f9-86b0-61165ba1ac7a req-3d697b20-8712-4cf4-8bea-cdb02cd95070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b025db2-3af4-4945-89af-46d94652c12e", "tag": "4769f633-b48b-4b72-b906-80999f75554f"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:42.313256 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b78552b8-f972-42f9-86b0-61165ba1ac7a req-3d697b20-8712-4cf4-8bea-cdb02cd95070 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:42.314223 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b78552b8-f972-42f9-86b0-61165ba1ac7a req-3d697b20-8712-4cf4-8bea-cdb02cd95070 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:42.314843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b78552b8-f972-42f9-86b0-61165ba1ac7a req-3d697b20-8712-4cf4-8bea-cdb02cd95070 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:42.331045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-b78552b8-f972-42f9-86b0-61165ba1ac7a req-3d697b20-8712-4cf4-8bea-cdb02cd95070 service nova] Creating event network-changed:4769f633-b48b-4b72-b906-80999f75554f for instance 9b025db2-3af4-4945-89af-46d94652c12e on hv-cinder-85425 Aug 24 03:55:42.337537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-b78552b8-f972-42f9-86b0-61165ba1ac7a req-3d697b20-8712-4cf4-8bea-cdb02cd95070 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044425 Aug 24 03:55:42.338473 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 530/1092] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:44.788360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-652594424", "imageRef": "3fc302fd-cc4d-4377-81f9-afa25bdda52d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7017dfb2-6dc7-4b44-a632-2d85a8be9995"}], "security_groups": [{"name": "tempest-securitygroup--86372079"}], "key_name": "tempest-keypair-1476358237", "user_data": "}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:44.821579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5f753272-b2c8-4450-a421-15d8e2b690d2 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Action: 'create', calling method: .version_select at 0x7f6c13592670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-856993380", "metadata": {"Type": "work"}}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:44.910137 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] validate_networks() for [('7017dfb2-6dc7-4b44-a632-2d85a8be9995', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:55:45.292953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:55:45.293403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:55:45.293877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:55:45.294318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:55:45.294734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:55:45.304183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:45.304680 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:45.305125 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:45.307408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:45.307408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:45.309940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:45.327497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:55:45.331973 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Getting quotas for user 77b4b56f008c44c081130377cf8ce630 and project 8f7520af1ae14ad28eec126353eaac53. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:55:45.344124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:55:45.346642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3fc302fd-cc4d-4377-81f9-afa25bdda52d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:55:45.488203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4b553a70-7155-4a89-af38-00ba90563f17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.705053 Aug 24 03:55:45.488854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 531/1093] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:55:44 2022] POST /compute/v2.1/servers => generated 400 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:55:45.499863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-36104567-d80e-4bb6-99af-594c70225064 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:45.500488 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-36104567-d80e-4bb6-99af-594c70225064 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:45.555201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-36104567-d80e-4bb6-99af-594c70225064 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:45.563479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-36104567-d80e-4bb6-99af-594c70225064 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1241 microversion: 2.1 time: 0.067676 Aug 24 03:55:45.564044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 532/1094] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:45 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:45.650395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5f753272-b2c8-4450-a421-15d8e2b690d2 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.953025 Aug 24 03:55:45.651028 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 563/1095] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 03:55:44 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 954 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 03:55:45.669187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c76890f6-684f-47bc-ab06-b5604d60dbc8 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Calling method '.version_select at 0x7f6c136f00d0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:45.720130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c76890f6-684f-47bc-ab06-b5604d60dbc8 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149" status: 200 len: 352 microversion: 2.1 time: 0.055303 Aug 24 03:55:45.720855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 533/1096] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:45 2022] GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:46.584775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:46.585405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:46.592278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.592765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.593206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.593924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:46.594429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:46.594860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:46.663047 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:46.677106 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-87f54392-1cf6-4830-a611-83717a39dba9 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1245 microversion: 2.1 time: 0.096624 Aug 24 03:55:46.678136 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 564/1097] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:46 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:46.737845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-86cee368-9591-4950-8b8d-eb8e673e900f tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Calling method '.version_select at 0x7f6c180674c0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:46.792736 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-86cee368-9591-4950-8b8d-eb8e673e900f tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149" status: 200 len: 353 microversion: 2.1 time: 0.060288 Aug 24 03:55:46.793367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 534/1098] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:46 2022] GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:46.806561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-742492f6-535e-424b-896b-6df59b3171f5 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Calling method '.version_select at 0x7f6c13711310>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:46.860814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-742492f6-535e-424b-896b-6df59b3171f5 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149" status: 200 len: 353 microversion: 2.1 time: 0.058072 Aug 24 03:55:46.861391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 565/1099] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:46 2022] GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:46.875361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3566b4a8-8ccc-4ee2-a9f7-f505448fe232 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Calling method '.version_select at 0x7f6c137f1af0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:47.146262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3566b4a8-8ccc-4ee2-a9f7-f505448fe232 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149" status: 202 len: 0 microversion: 2.1 time: 0.275521 Aug 24 03:55:47.153142 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 535/1100] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:55:46 2022] DELETE /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:55:47.155613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a0c3be81-f789-4429-9302-389ca88d3ef6 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Calling method '.version_select at 0x7f6c136ce670>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:47.207914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a0c3be81-f789-4429-9302-389ca88d3ef6 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149" status: 200 len: 352 microversion: 2.1 time: 0.056774 Aug 24 03:55:47.212072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 566/1101] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:47 2022] GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:47.708678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:47.709213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:47.716433 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:47.716923 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:47.717361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:47.718172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:47.718646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:47.719077 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:47.783624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:47.791674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ea82f3e2-dfba-4086-b261-81baac4bde3e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1293 microversion: 2.1 time: 0.087251 Aug 24 03:55:47.792251 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 536/1102] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:47 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:48.222730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-526cf93d-9d63-4447-9e25-2f00620f7142 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Calling method '.version_select at 0x7f6c137eeaf0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:48.250999 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-526cf93d-9d63-4447-9e25-2f00620f7142 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] HTTP exception thrown: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-526cf93d-9d63-4447-9e25-2f00620f7142 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Request method failure captured: Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 HTTP/1.1 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaFAvQOjheNxQ8yg7wzgnNIrimm0sz_3rY86ygIx9ztUzGX8uXZmKgpiSC5ZSYcIAXgf-Imvyrs2qtS8EXQi8SfYja_Q49kgrTTtsMCi4sGNgOfxB1ZIDGd8i0NXvI-z4I4kQ3E97QJcpGA1cl9qC9GnEJ9iPqyRbVHgMhThZwdC_m0 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 7704ebd24a8a4613bdfbdd1fbc3622c9 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesGetTestJSON-1499493586 Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:55:48.253172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7704ebd24a8a4613bdfbdd1fbc3622c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7704ebd24a8a4613bdfbdd1fbc3622c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7704ebd24a8a4613bdfbdd1fbc3622c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7704ebd24a8a4613bdfbdd1fbc3622c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesGetTestJSON-1499493586 Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 7704ebd24a8a4613bdfbdd1fbc3622c9 Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesGetTestJSON-1499493586 Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesGetTestJSON-1499493586-project Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 197934dd4e054f52af516b538fe9bd0a Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesGetTestJSON-1499493586-project Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '0a772fe2-fba4-464e-b0dd-32bbdbb18149'} Aug 24 03:55:48.254972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. (HTTP 404) (Request-ID: req-f6158201-bcbb-4bc0-b48a-39f4798043f5) Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:48.255880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:55:48.257114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:55:48.258501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-526cf93d-9d63-4447-9e25-2f00620f7142 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] Returning 404 to user: Volume 0a772fe2-fba4-464e-b0dd-32bbdbb18149 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-526cf93d-9d63-4447-9e25-2f00620f7142 tempest-VolumesGetTestJSON-1499493586 tempest-VolumesGetTestJSON-1499493586-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149" status: 404 len: 109 microversion: 2.1 time: 0.036484 Aug 24 03:55:48.259932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 567/1103] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:48 2022] GET /compute/v2.1/os-volumes/0a772fe2-fba4-464e-b0dd-32bbdbb18149 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:55:48.816066 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:48.817084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:48.823916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:48.825397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:48.825397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:48.826190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:48.827857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:48.828448 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:48.898141 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:48.905942 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ba4e8ad7-055c-4ba6-9a1d-0d543291e57c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1299 microversion: 2.1 time: 0.093801 Aug 24 03:55:48.906547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 537/1104] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:48 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:49.929458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:49.930009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:49.937024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.937517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.937961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:49.938725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:49.939277 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:49.939708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:50.088886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:50.097246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3a31fd8d-f1cb-4c83-803a-35c342608e86 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.172349 Aug 24 03:55:50.097917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 568/1105] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:49 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:50.460587 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-b6ff1968-16b5-433c-962e-5ccd67544a8e req-4ce8438e-d31f-4d93-b22b-38bc42c348c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df82cb36-fb91-4829-8c75-2d7c94d74eef", "tag": "72e2dfbe-8467-4850-ba3f-131944e3adbd"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:50.476621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b6ff1968-16b5-433c-962e-5ccd67544a8e req-4ce8438e-d31f-4d93-b22b-38bc42c348c1 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:50.477101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b6ff1968-16b5-433c-962e-5ccd67544a8e req-4ce8438e-d31f-4d93-b22b-38bc42c348c1 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:50.477527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b6ff1968-16b5-433c-962e-5ccd67544a8e req-4ce8438e-d31f-4d93-b22b-38bc42c348c1 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:50.504122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-b6ff1968-16b5-433c-962e-5ccd67544a8e req-4ce8438e-d31f-4d93-b22b-38bc42c348c1 service nova] Creating event network-changed:72e2dfbe-8467-4850-ba3f-131944e3adbd for instance df82cb36-fb91-4829-8c75-2d7c94d74eef on hv-cinder-85425 Aug 24 03:55:50.510185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-b6ff1968-16b5-433c-962e-5ccd67544a8e req-4ce8438e-d31f-4d93-b22b-38bc42c348c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052418 Aug 24 03:55:50.510883 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 538/1106] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:51.118590 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:51.119215 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:51.125884 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:51.126393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:51.126839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:51.127591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:51.128023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:51.128449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:51.340820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:51.348680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fe204fcf-9317-49cb-a723-edceed95ee37 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.233956 Aug 24 03:55:51.349239 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 569/1107] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:51 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:52.372251 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:52.372957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:52.380991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:52.381480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:52.381933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:52.382670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:52.383130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:52.383561 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:52.523540 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:52.529849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-241eeb04-6c8f-40eb-ba5b-47385cf14aae tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c137be160>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:52.532359 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-550bcfce-83d2-487b-8f6c-742a08b49f1c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.165724 Aug 24 03:55:52.533060 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 539/1108] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:52 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:52.536364 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=4 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:52.584414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-241eeb04-6c8f-40eb-ba5b-47385cf14aae tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4d20dcde-7522-47d5-adb9-603ade089abf" status: 200 len: 350 microversion: 2.1 time: 0.059654 Aug 24 03:55:52.587554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 570/1109] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:52 2022] GET /compute/v2.1/os-volumes/4d20dcde-7522-47d5-adb9-603ade089abf => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:53.554381 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:53.554951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:53.562184 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:53.562683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:53.563124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:53.563816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:53.564272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:53.564697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:53.711493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:53.719753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ca8a40db-db8c-4d8e-8b84-58f84323c264 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.169368 Aug 24 03:55:53.720321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 540/1110] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:53 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:54.260853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-64fcc6a0-bfd8-486a-8af1-0b4669205eea tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c13635f70>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:54.310073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-64fcc6a0-bfd8-486a-8af1-0b4669205eea tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b37d113a-1817-4cd5-baac-77c0c4879221" status: 200 len: 349 microversion: 2.1 time: 0.054103 Aug 24 03:55:54.319129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 571/1111] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:54 2022] GET /compute/v2.1/os-volumes/b37d113a-1817-4cd5-baac-77c0c4879221 => generated 349 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:54.422438 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:54.423101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:54.431138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:54.431944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:54.432398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:54.433211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:54.433678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:54.434109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:54.464452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b0b05d34-f936-445f-9175-56483a33ca52 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/ips" status: 200 len: 151 microversion: 2.20 time: 0.043458 Aug 24 03:55:54.464452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 541/1112] 10.222.0.65 () {60 vars in 1289 bytes} [Wed Aug 24 03:55:54 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:55:54.741394 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:54.741928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:54.748798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:54.749338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:54.749752 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:54.750490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:54.750945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:54.751366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:54.882832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:54.892344 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3c696008-0bf4-417b-887b-9f3bfce26558 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.154894 Aug 24 03:55:54.893177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 572/1113] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:54 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:55.915183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:55.915801 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:55.919134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:55.919841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=8 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:55.924862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:55.925344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:55.925840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:55.926569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:55.927027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:55.927460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:56.069336 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:56.077312 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-14a6facd-7047-4153-bccf-733ba4f4a94a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.165969 Aug 24 03:55:56.077893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 542/1114] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:55 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:56.591860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-e88dc994-afec-497c-945b-4ffa07a8c0d2 req-eda2f08a-68f6-4b04-8305-d4dd660dc057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df82cb36-fb91-4829-8c75-2d7c94d74eef", "name": "network-vif-plugged", "status": "completed", "tag": "72e2dfbe-8467-4850-ba3f-131944e3adbd"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:56.602192 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-e88dc994-afec-497c-945b-4ffa07a8c0d2 req-eda2f08a-68f6-4b04-8305-d4dd660dc057 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:56.602747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-e88dc994-afec-497c-945b-4ffa07a8c0d2 req-eda2f08a-68f6-4b04-8305-d4dd660dc057 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:56.603189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-e88dc994-afec-497c-945b-4ffa07a8c0d2 req-eda2f08a-68f6-4b04-8305-d4dd660dc057 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:56.615626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-e88dc994-afec-497c-945b-4ffa07a8c0d2 req-eda2f08a-68f6-4b04-8305-d4dd660dc057 service nova] Creating event network-vif-plugged:72e2dfbe-8467-4850-ba3f-131944e3adbd for instance df82cb36-fb91-4829-8c75-2d7c94d74eef on hv-cinder-85425 Aug 24 03:55:56.621369 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-e88dc994-afec-497c-945b-4ffa07a8c0d2 req-eda2f08a-68f6-4b04-8305-d4dd660dc057 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033865 Aug 24 03:55:56.622035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 573/1115] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:57.070219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-10b5035c-066f-4a42-8a9d-024f96c2d90b tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c180979d0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.099154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.099949 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:57.109100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:57.109100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:57.109533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:57.110528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:57.111230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:57.112504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:57.136053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-10b5035c-066f-4a42-8a9d-024f96c2d90b tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/fddf394b-8b7a-47e6-b13a-69089de8cec3" status: 200 len: 351 microversion: 2.1 time: 0.066431 Aug 24 03:55:57.136053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 543/1116] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes/fddf394b-8b7a-47e6-b13a-69089de8cec3 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:57.146403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-de68a083-2398-4c97-b83e-638ae31c6631 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c13678ee0>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.232918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-de68a083-2398-4c97-b83e-638ae31c6631 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090241 Aug 24 03:55:57.233522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 544/1117] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:57.248192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1f37d84c-4a23-4c12-95a4-fe3cf6677616 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c137f1280>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.257269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:57.265890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7f252a3c-1d17-45c5-a584-c19a11d40194 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.171323 Aug 24 03:55:57.266522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 574/1118] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:57.343111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1f37d84c-4a23-4c12-95a4-fe3cf6677616 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090350 Aug 24 03:55:57.343111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 545/1119] 10.222.0.65 () {58 vars in 1149 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:57.348478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dd8412eb-779d-4204-ba38-7cbdd4f42dc2 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c13767af0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.430558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dd8412eb-779d-4204-ba38-7cbdd4f42dc2 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085764 Aug 24 03:55:57.431127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 575/1120] 10.222.0.65 () {58 vars in 1134 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:57.444248 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b6cbd0f7-b680-4ae5-b9cc-592526599238 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c136f2d30>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.538440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b6cbd0f7-b680-4ae5-b9cc-592526599238 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.097825 Aug 24 03:55:57.539055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 546/1121] 10.222.0.65 () {58 vars in 1167 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:57.553220 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c3b5e498-b043-4d9f-a6b9-21f2b4592a9f tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c136ce4c0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.640015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c3b5e498-b043-4d9f-a6b9-21f2b4592a9f tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091420 Aug 24 03:55:57.640641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 576/1122] 10.222.0.65 () {58 vars in 1170 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:55:57.654416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f6e1e4cd-ece5-4a6f-b3e3-3af8a0f368c7 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c137e9700>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.736310 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f6e1e4cd-ece5-4a6f-b3e3-3af8a0f368c7 tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085949 Aug 24 03:55:57.736881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 547/1123] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:57.750378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-163473f4-e431-4b45-8907-92624a854f5a tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c137ee670>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.836016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-163473f4-e431-4b45-8907-92624a854f5a tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.089471 Aug 24 03:55:57.836584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 577/1124] 10.222.0.65 () {58 vars in 1188 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:57.849279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-76737d7a-9543-42fe-83b4-904a079a4a4b tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] Calling method '.version_select at 0x7f6c18097e50>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:57.933659 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-76737d7a-9543-42fe-83b4-904a079a4a4b tempest-VolumesTestJSON-2117300558 tempest-VolumesTestJSON-2117300558-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087573 Aug 24 03:55:57.934237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 548/1125] 10.222.0.65 () {58 vars in 1155 bytes} [Wed Aug 24 03:55:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:58.286825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:58.287468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:58.294854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.295291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.295725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.296426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.296878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.297296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.436313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:58.444030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a07f2b35-9c42-436f-be41-6d0620f30538 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1365 microversion: 2.1 time: 0.161107 Aug 24 03:55:58.444599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 578/1126] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:58 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:55:58.528510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:55:58.529111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:58.535177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.535688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.536122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.536807 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:58.537252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:58.537721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:58.561887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'flavor' on Instance uuid b1edcdfc-1f9f-49fc-9765-88a550b1678b {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:55:58.687394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:59.160727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a199b08f-974b-49ed-9da7-8baa5c97ab4f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/action" status: 202 len: 0 microversion: 2.20 time: 0.637283 Aug 24 03:55:59.163431 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 549/1127] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 03:55:58 2022] POST /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:55:59.173946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.174624 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.181635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.183742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.183742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.184107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.184418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.184836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.184977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.185308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.191394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.191877 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.192308 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.193000 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.193452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.193865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.223259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:55:59.351366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.360594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.363568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.364924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f896aee6-b1e4-4d46-b166-f991b75f7c15 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.196086 Aug 24 03:55:59.365508 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 579/1128] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:55:59.464665 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.465325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.471691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.472112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.472553 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.473258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.473710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.474140 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.495405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:59.636964 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:55:59.644756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8b2c92f7-5dfd-4377-a793-ee48af849261 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1555 microversion: 2.1 time: 0.184608 Aug 24 03:55:59.645324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 580/1129] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:55:59.665705 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.666236 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.672993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.673478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.673913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.674639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.675122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.675567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.756291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ff8d78e8-b0f6-401b-8fa7-25b097ca6f66 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094396 Aug 24 03:55:59.756882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 581/1130] 10.222.0.65 () {58 vars in 1275 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:55:59.821899 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-84e6cc36-dba1-4661-a36f-38389fdb0b4f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 204 len: 0 microversion: 2.1 time: 0.644589 Aug 24 03:55:59.828100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 550/1131] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:55:59 2022] DELETE /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:55:59.832377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:55:59.833154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:55:59.840006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.840552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.840986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:55:59.842350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:55:59.842839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:55:59.843265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.088656 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.096482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3cad68e7-9023-4886-82f4-57d0761abafc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1578 microversion: 2.1 time: 0.268488 Aug 24 03:56:00.097080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 582/1132] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:55:59 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:00.389829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:00.390707 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:00.396765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.397251 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.397691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.398484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:00.398940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:00.399410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:00.680475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.689369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.690936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:00.692124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4d503371-aea5-4bcd-aecf-adcdc6e0d5c2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.306782 Aug 24 03:56:00.692678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 551/1133] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:00 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:01.119045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:01.119693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:01.126332 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.126832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.127273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.127976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.128430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.128857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.300408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-d4031fe8-aad4-4208-8720-9f3f807d562c req-c02491e2-f62b-49c8-ac57-f486ceb7d8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df82cb36-fb91-4829-8c75-2d7c94d74eef", "tag": "72e2dfbe-8467-4850-ba3f-131944e3adbd"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:01.310724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d4031fe8-aad4-4208-8720-9f3f807d562c req-c02491e2-f62b-49c8-ac57-f486ceb7d8aa service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.311519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d4031fe8-aad4-4208-8720-9f3f807d562c req-c02491e2-f62b-49c8-ac57-f486ceb7d8aa service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.311953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d4031fe8-aad4-4208-8720-9f3f807d562c req-c02491e2-f62b-49c8-ac57-f486ceb7d8aa service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.320814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:01.325357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-d4031fe8-aad4-4208-8720-9f3f807d562c req-c02491e2-f62b-49c8-ac57-f486ceb7d8aa service nova] Creating event network-changed:72e2dfbe-8467-4850-ba3f-131944e3adbd for instance df82cb36-fb91-4829-8c75-2d7c94d74eef on hv-cinder-85425 Aug 24 03:56:01.330651 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9de7217e-7785-4565-8a49-98cf49522662 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1578 microversion: 2.1 time: 0.215332 Aug 24 03:56:01.331511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 583/1134] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:01 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:01.335112 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-d4031fe8-aad4-4208-8720-9f3f807d562c req-c02491e2-f62b-49c8-ac57-f486ceb7d8aa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038788 Aug 24 03:56:01.335868 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 552/1135] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:01.717213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:01.717899 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:01.724488 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.724978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.725439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.726188 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:01.726633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:01.727088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:01.881048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:01.891717 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:01.894019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:01.895381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dbddf481-138f-41a5-80da-2282c2067df3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.182966 Aug 24 03:56:01.897478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 584/1136] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:01 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:02.358318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:02.359880 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:02.366282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:02.367225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:02.367767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:02.368577 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:02.369146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:02.369789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:02.597993 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:02.609978 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-85e3eaf9-afe5-43ef-89f3-d1538613b372 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1578 microversion: 2.1 time: 0.257659 Aug 24 03:56:02.610857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 553/1137] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:02 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:02.927537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:02.928511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:02.936943 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:02.937589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:02.938765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:02.939830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:02.940357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:02.940914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.165730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.175426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.177017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.178218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3c4348a5-cff0-4c94-99e5-598368304587 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.255763 Aug 24 03:56:03.178781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 585/1138] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:02 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:03.636849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:03.649881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:03.649881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.649881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.649881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.650392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.650392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.650392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.714068 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:03.722635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ec44e049-6522-4d22-88d4-10d3a3db2fe4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1511 microversion: 2.1 time: 0.090218 Aug 24 03:56:03.723218 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 554/1139] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:03 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1511 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:03.846703 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-a5a2e65e-b578-4199-89ef-b6576fd481ac req-9acd8748-a974-4578-aee9-5bdd105cc865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ca0e0-691f-45a3-a98a-8ddfda13473d", "name": "network-vif-deleted", "tag": "3f848c01-a648-40ce-965b-af3528a5a06c"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:03.856846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a5a2e65e-b578-4199-89ef-b6576fd481ac req-9acd8748-a974-4578-aee9-5bdd105cc865 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:03.857623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a5a2e65e-b578-4199-89ef-b6576fd481ac req-9acd8748-a974-4578-aee9-5bdd105cc865 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:03.858270 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-a5a2e65e-b578-4199-89ef-b6576fd481ac req-9acd8748-a974-4578-aee9-5bdd105cc865 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:03.871621 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-a5a2e65e-b578-4199-89ef-b6576fd481ac req-9acd8748-a974-4578-aee9-5bdd105cc865 service nova] Creating event network-vif-deleted:3f848c01-a648-40ce-965b-af3528a5a06c for instance 902ca0e0-691f-45a3-a98a-8ddfda13473d on hv-cinder-85425 Aug 24 03:56:03.876913 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-a5a2e65e-b578-4199-89ef-b6576fd481ac req-9acd8748-a974-4578-aee9-5bdd105cc865 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033821 Aug 24 03:56:03.877768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 586/1140] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:04.206514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:04.209188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:04.214095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.214631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.215091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.215814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.216397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.216825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.361314 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.370347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.371979 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.373155 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5755eda8-f2a9-4d9b-8aa8-191fe84cadeb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.171052 Aug 24 03:56:04.373753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 555/1141] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:04 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:04.751596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:04.753079 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:04.766342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.767918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.768591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.769358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:04.769974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:04.770617 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:04.857893 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:04.869325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ef575d7b-e87e-417a-9f69-5494a382d0b4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 200 len: 1226 microversion: 2.1 time: 0.126421 Aug 24 03:56:04.870869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 587/1142] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:04 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 1226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:05.015477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5b352a89-7c1e-40bd-9563-7620f3fecec4 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Action: 'create', calling method: .version_select at 0x7f6c137504c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-33831592", "metadata": {"Type": "work"}}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5b352a89-7c1e-40bd-9563-7620f3fecec4 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Request method failure captured: Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 120 Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaFUs2k82LkgNGxye0nV8GAECTOg-FL14fxpVh8njQyN-GxwrThRW-HLTWJSq7unccF4WpkvHeDRFNakDUTK-c1KcziYE4t2ZZRFA_1CQOUZ0GO1Lw1P8mM6Z0EMrNhkph4s1ji6iWVGOuBN1F27l15aA_bCWYJc-zWGE7rvpttagOQ Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:56:05.023558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 8ada345d494840f0ae873af5db1f882d Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-33831592", "metadata": {"Type": "work"}}} Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: Aug 24 03:56:05.025260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-33831592', 'metadata': {'Type': 'work'}}}} Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.026491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:56:05.028435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:56:05.030828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 03:56:05.030828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.030828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5b352a89-7c1e-40bd-9563-7620f3fecec4 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.030828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5b352a89-7c1e-40bd-9563-7620f3fecec4 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.189863 Aug 24 03:56:05.030828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 556/1143] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 03:56:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:56:05.034816 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-98282732-1a96-4c4c-a9bc-c619d3fc35b7 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Action: 'create', calling method: .version_select at 0x7f6c13704a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-325974836", "metadata": {"Type": "work"}}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-98282732-1a96-4c4c-a9bc-c619d3fc35b7 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Request method failure captured: Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 119 Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaFUs2k82LkgNGxye0nV8GAECTOg-FL14fxpVh8njQyN-GxwrThRW-HLTWJSq7unccF4WpkvHeDRFNakDUTK-c1KcziYE4t2ZZRFA_1CQOUZ0GO1Lw1P8mM6Z0EMrNhkph4s1ji6iWVGOuBN1F27l15aA_bCWYJc-zWGE7rvpttagOQ Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:56:05.039618 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 8ada345d494840f0ae873af5db1f882d Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-325974836", "metadata": {"Type": "work"}}} Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:56:05.041167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-325974836', 'metadata': {'Type': 'work'}}}} Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi '0' Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.042142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:56:05.043799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:56:05.045345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 03:56:05.045345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.045345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-98282732-1a96-4c4c-a9bc-c619d3fc35b7 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.045345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-98282732-1a96-4c4c-a9bc-c619d3fc35b7 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010097 Aug 24 03:56:05.045345 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 588/1144] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 03:56:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:56:05.050602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-80f61273-1119-44c9-83af-8d046e4950ed tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Action: 'create', calling method: .version_select at 0x7f6c1363e280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1766286213", "metadata": {"Type": "work"}}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-80f61273-1119-44c9-83af-8d046e4950ed tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Request method failure captured: Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 119 Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaFUs2k82LkgNGxye0nV8GAECTOg-FL14fxpVh8njQyN-GxwrThRW-HLTWJSq7unccF4WpkvHeDRFNakDUTK-c1KcziYE4t2ZZRFA_1CQOUZ0GO1Lw1P8mM6Z0EMrNhkph4s1ji6iWVGOuBN1F27l15aA_bCWYJc-zWGE7rvpttagOQ Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:56:05.054104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 8ada345d494840f0ae873af5db1f882d Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1766286213", "metadata": {"Type": "work"}}} Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: Aug 24 03:56:05.055668 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1766286213', 'metadata': {'Type': 'work'}}}} Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi '' Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.056774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:56:05.059121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:56:05.060600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 03:56:05.060600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.060600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-80f61273-1119-44c9-83af-8d046e4950ed tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.060600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-80f61273-1119-44c9-83af-8d046e4950ed tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008638 Aug 24 03:56:05.060600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 557/1145] 10.222.0.65 () {60 vars in 1156 bytes} [Wed Aug 24 03:56:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:56:05.065190 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f33ad863-1233-4e0f-af8f-60357c1be8f8 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Calling method '.version_select at 0x7f6c136ce5e0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.094633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-f33ad863-1233-4e0f-af8f-60357c1be8f8 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] HTTP exception thrown: Volume tempest-invalid-1565906844 could not be found. Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f33ad863-1233-4e0f-af8f-60357c1be8f8 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Request method failure captured: Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1565906844 HTTP/1.1 Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaFUs2k82LkgNGxye0nV8GAECTOg-FL14fxpVh8njQyN-GxwrThRW-HLTWJSq7unccF4WpkvHeDRFNakDUTK-c1KcziYE4t2ZZRFA_1CQOUZ0GO1Lw1P8mM6Z0EMrNhkph4s1ji6iWVGOuBN1F27l15aA_bCWYJc-zWGE7rvpttagOQ Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:56:05.096587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 8ada345d494840f0ae873af5db1f882d Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Volume tempest-invalid-1565906844 could not be found. Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'tempest-invalid-1565906844'} Aug 24 03:56:05.098283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1565906844 could not be found. (HTTP 404) (Request-ID: req-32c8b8f7-94db-46d5-b7fc-3339f239f980) Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.099403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:56:05.100829 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1565906844 could not be found. Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:05.101968 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1565906844 could not be found. Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1565906844 could not be found. Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f33ad863-1233-4e0f-af8f-60357c1be8f8 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Returning 404 to user: Volume tempest-invalid-1565906844 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f33ad863-1233-4e0f-af8f-60357c1be8f8 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1565906844" status: 404 len: 99 microversion: 2.1 time: 0.036797 Aug 24 03:56:05.103843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 589/1146] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 03:56:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1565906844 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 03:56:05.111860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-50e07d7d-750c-4cb5-9307-d15885814d0d tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003894 Aug 24 03:56:05.112371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 558/1147] 10.222.0.65 () {58 vars in 1140 bytes} [Wed Aug 24 03:56:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:56:05.122377 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-196760f0-0573-45ac-a320-45c14fe3da36 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004719 Aug 24 03:56:05.123072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 590/1148] 10.222.0.65 () {58 vars in 1137 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 03:56:05.133713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2ffb3f90-daa0-49e1-b258-6033808e8a33 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Calling method '.version_select at 0x7f6c19c8dd30>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.163848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-2ffb3f90-daa0-49e1-b258-6033808e8a33 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] HTTP exception thrown: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2ffb3f90-daa0-49e1-b258-6033808e8a33 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Request method failure captured: Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: DELETE /compute/v2.1/os-volumes/743896b4-deff-48a1-b043-c4988a95797c HTTP/1.1 Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaFUs2k82LkgNGxye0nV8GAECTOg-FL14fxpVh8njQyN-GxwrThRW-HLTWJSq7unccF4WpkvHeDRFNakDUTK-c1KcziYE4t2ZZRFA_1CQOUZ0GO1Lw1P8mM6Z0EMrNhkph4s1ji6iWVGOuBN1F27l15aA_bCWYJc-zWGE7rvpttagOQ Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:56:05.168072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 8ada345d494840f0ae873af5db1f882d Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '743896b4-deff-48a1-b043-c4988a95797c'} Aug 24 03:56:05.169665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. (HTTP 404) (Request-ID: req-a742529e-d3ba-4a36-b2b4-5983b47d905d) Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.174651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 03:56:05.176118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 03:56:05.177523 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2ffb3f90-daa0-49e1-b258-6033808e8a33 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Returning 404 to user: Volume 743896b4-deff-48a1-b043-c4988a95797c could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2ffb3f90-daa0-49e1-b258-6033808e8a33 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/743896b4-deff-48a1-b043-c4988a95797c" status: 404 len: 109 microversion: 2.1 time: 0.039982 Aug 24 03:56:05.178933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 559/1149] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:56:05 2022] DELETE /compute/v2.1/os-volumes/743896b4-deff-48a1-b043-c4988a95797c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:56:05.179963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fd29f6c2-f424-4263-864c-ea6eef82d532 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Calling method '.version_select at 0x7f6c137eeee0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.207780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-fd29f6c2-f424-4263-864c-ea6eef82d532 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] HTTP exception thrown: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fd29f6c2-f424-4263-864c-ea6eef82d532 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Request method failure captured: Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/os-volumes/6c39dd05-6154-490e-831b-cd9f3ec57f92 HTTP/1.1 Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaFUs2k82LkgNGxye0nV8GAECTOg-FL14fxpVh8njQyN-GxwrThRW-HLTWJSq7unccF4WpkvHeDRFNakDUTK-c1KcziYE4t2ZZRFA_1CQOUZ0GO1Lw1P8mM6Z0EMrNhkph4s1ji6iWVGOuBN1F27l15aA_bCWYJc-zWGE7rvpttagOQ Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:56:05.209766 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c53eb7ecb428418ca61ef5e5dc6252da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: c53eb7ecb428418ca61ef5e5dc6252da Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-VolumesNegativeTest-756729764 Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 8ada345d494840f0ae873af5db1f882d Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-VolumesNegativeTest-756729764-project Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '6c39dd05-6154-490e-831b-cd9f3ec57f92'} Aug 24 03:56:05.212061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. (HTTP 404) (Request-ID: req-14d8721c-992e-440d-a503-bdb734e0fb94) Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.214544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 03:56:05.216991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 03:56:05.219710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fd29f6c2-f424-4263-864c-ea6eef82d532 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] Returning 404 to user: Volume 6c39dd05-6154-490e-831b-cd9f3ec57f92 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fd29f6c2-f424-4263-864c-ea6eef82d532 tempest-VolumesNegativeTest-756729764 tempest-VolumesNegativeTest-756729764-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/6c39dd05-6154-490e-831b-cd9f3ec57f92" status: 404 len: 109 microversion: 2.1 time: 0.035812 Aug 24 03:56:05.222857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 591/1150] 10.222.0.65 () {58 vars in 1245 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/os-volumes/6c39dd05-6154-490e-831b-cd9f3ec57f92 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:56:05.397094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.397890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:05.406015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.406485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.406916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.407626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.408083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.408514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.551172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:05.561326 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:05.586976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:05.586976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-224586bf-e4bb-40d5-9ab6-e5bfd290fb65 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.171070 Aug 24 03:56:05.586976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 560/1151] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:05.894695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:05.895541 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:05.901908 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.902527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.903046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.903798 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:05.904379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:05.904695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:05.919165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] HTTP exception thrown: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Request method failure captured: Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d HTTP/1.1 Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaBQuTuIGAAB3fObggHoQW_Xno49tkv2gwkvr0o237akeNYQHpnrgN1SD64IeNJWpvBpatHnMSKfX5JIGeyjqDQBbDDkuvU2IeOJm796nbvbE5hGxD9KhpHnHMswLYUfKrchNrdnh675PqnVYcUH6U93yWs1yv8D8rOYhRJkM8GNFHE Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:56:05.920825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-TestVolumeBootPattern-663059075 Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-TestVolumeBootPattern-663059075-project Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 71ff73cade8b42c7ae57be1e3ef0e028 Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-TestVolumeBootPattern-663059075-project Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 03:56:05.922300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '902ca0e0-691f-45a3-a98a-8ddfda13473d'} Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:56:05.923124 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 03:56:05.924368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:56:05.926531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Returning 404 to user: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:56:05.926531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4e9eec6b-c684-4908-9ded-cd32b7f5a070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 404 len: 111 microversion: 2.1 time: 0.032809 Aug 24 03:56:05.926531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 592/1152] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:05 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:56:06.034541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-920002295", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1056783115", "security_groups": [{"name": "tempest-secgroup-smoke-550765759"}], "block_device_mapping_v2": [{"uuid": "4bd5680c-7f8d-4be6-a64e-cfb640a0794e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8e8b02d-24a6-4dbc-a526-ca5dd9721bf6"}]}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:06.046011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:06.173149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] validate_networks() for [('e8e8b02d-24a6-4dbc-a526-ca5dd9721bf6', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:56:06.588970 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:06.590230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:06.592504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:06.597637 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.598271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.599390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.600146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.600605 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.601038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.735643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:56:06.735800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:56:06.736328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:56:06.736762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:56:06.737168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:56:06.746227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.746852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.747289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.748201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:06.748673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:06.749095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:06.766834 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:56:06.770957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for user 71ff73cade8b42c7ae57be1e3ef0e028 and project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:56:06.782040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.791355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.793689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:06.794904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dc632a99-253d-45ca-8361-028fc1efc0a1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.210711 Aug 24 03:56:06.795492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 593/1153] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:06 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:06.835740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:56:06.837913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bd5680c-7f8d-4be6-a64e-cfb640a0794e',volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:56:07.388120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2efac59d-4376-46ae-a414-f88d8c1c2d93 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.357636 Aug 24 03:56:07.395162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 561/1154] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:56:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:56:07.400104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c93db504-8230-4ba3-8a53-6edb81ac6c09 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:07.400736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c93db504-8230-4ba3-8a53-6edb81ac6c09 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:07.465717 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c93db504-8230-4ba3-8a53-6edb81ac6c09 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:07.473833 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c93db504-8230-4ba3-8a53-6edb81ac6c09 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1094 microversion: 2.1 time: 0.077574 Aug 24 03:56:07.474484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 594/1155] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:07 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:07.820387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:07.823397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:07.833078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:07.833881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:07.834646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:07.835824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:07.836603 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:07.837337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.018135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.027408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.028906 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.030089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0a70e7b6-173a-4d61-b969-feaf1ea6e632 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.215853 Aug 24 03:56:08.040522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 562/1156] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:07 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:08.496822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:08.497380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:08.505675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.506188 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.506644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.507359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:08.507868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:08.508324 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:08.574397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:08.582569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-39e14e9a-8504-43e1-b926-e7c0de33d8f8 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1144 microversion: 2.1 time: 0.090358 Aug 24 03:56:08.594475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 595/1157] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:08 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:09.053853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.054517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.062143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.062654 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.063165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.064527 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.064981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.065463 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.217302 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.226078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.227861 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.229338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fa5abec2-7db3-4ea9-b8ec-4abc3675b23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.179265 Aug 24 03:56:09.230935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 563/1158] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:09 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:09.605756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:09.606397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:09.613547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.614038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.614508 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.615221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:09.615677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:09.617889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:09.691045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:09.699457 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fa9b75ab-f769-47db-badb-c753dc0f8e7d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1192 microversion: 2.1 time: 0.098573 Aug 24 03:56:09.700048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 596/1159] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:09 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:10.255401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:10.256039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:10.265620 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.266127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.267606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.268435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.269098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.270461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.423397 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:10.433602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:10.435365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:10.441582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3170df11-deb5-4dde-83fa-3c53c09b32d7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.186526 Aug 24 03:56:10.441582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 564/1160] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:10 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:10.722778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:10.724303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:10.732386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.733097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.733946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.734693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:10.735152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:10.735580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:10.800211 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:10.808756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a8fcb068-fb29-419c-a6d8-a3b0596a73ef tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1210 microversion: 2.1 time: 0.090315 Aug 24 03:56:10.809331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 597/1161] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:10 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:11.464224 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.465758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.473303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.474102 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.476210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.476210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.476210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.476210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.631795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.641100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.642795 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:11.645896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1bcd087f-0227-46ee-b85f-a21bfce17f34 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.185167 Aug 24 03:56:11.645896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 565/1162] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:11 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:11.830542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:11.831655 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:11.838425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.838912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.839360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.840174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:11.840629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:11.841055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:11.997167 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.005232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cd81c519-bbf7-40b3-b7ef-0525c76a3c3e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1277 microversion: 2.1 time: 0.178571 Aug 24 03:56:12.006315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 598/1163] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:11 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:12.514901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-089b579d-7fd0-4886-9659-f1e7fff6b64a req-43334de7-fd16-4163-a1b3-3cff0c7a1af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b623ffb6-0e7e-415a-a935-6483fc304ae7", "tag": "3b118ff2-c881-4155-9de9-cbf9bda38ef3"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:12.527163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-089b579d-7fd0-4886-9659-f1e7fff6b64a req-43334de7-fd16-4163-a1b3-3cff0c7a1af8 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.527887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-089b579d-7fd0-4886-9659-f1e7fff6b64a req-43334de7-fd16-4163-a1b3-3cff0c7a1af8 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.528318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-089b579d-7fd0-4886-9659-f1e7fff6b64a req-43334de7-fd16-4163-a1b3-3cff0c7a1af8 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.560528 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-089b579d-7fd0-4886-9659-f1e7fff6b64a req-43334de7-fd16-4163-a1b3-3cff0c7a1af8 service nova] Creating event network-changed:3b118ff2-c881-4155-9de9-cbf9bda38ef3 for instance b623ffb6-0e7e-415a-a935-6483fc304ae7 on hv-cinder-85425 Aug 24 03:56:12.570064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-089b579d-7fd0-4886-9659-f1e7fff6b64a req-43334de7-fd16-4163-a1b3-3cff0c7a1af8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060026 Aug 24 03:56:12.575231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 566/1164] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:12.669023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:12.669625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:12.675487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.675959 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.676524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.677246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:12.677872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:12.678354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:12.825339 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.833484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.835135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:12.836484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f53c9ba4-4e74-484a-ab9d-86e994b2acc4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.172322 Aug 24 03:56:12.837090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 599/1165] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:12 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:13.028586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:13.029390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:13.036092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.042799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.042799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.042799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.042799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.043419 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.186842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:13.196949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a983fc45-5ebf-4cec-8398-86426a981fe9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.171083 Aug 24 03:56:13.196949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 567/1166] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:13 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:13.860741 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:13.861355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:13.867691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.868170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.868612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:13.869329 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:13.870550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:13.871022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.018629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.028684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.030610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.031790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1bcf5422-56a7-4cf4-8675-2f1a5a6ac13a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.175073 Aug 24 03:56:14.034597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 600/1167] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:13 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:14.220036 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:14.220618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:14.227407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.227891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.228382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.229960 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:14.230461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:14.230887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:14.375253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:14.383002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-83894c4e-f86b-4603-a022-23e07a492b48 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.167172 Aug 24 03:56:14.383577 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 568/1168] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:14 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:15.055226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.055853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.063173 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.063660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.064103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.065714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.066208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.069258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.198278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:15.207073 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:15.208600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:15.209762 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-217acb2e-05d4-40a8-a523-1d6a88e1af2a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.158743 Aug 24 03:56:15.210333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 601/1169] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:15.405074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:15.405595 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:15.413537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.414027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.414493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.415205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:15.415659 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:15.416093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:15.553467 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:15.558038 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:15.563321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-13484aaa-1ced-492d-87e4-f6e1e35eba55 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.163291 Aug 24 03:56:15.564169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 569/1170] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:15 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:16.234494 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:16.235115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:16.243141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.243623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.244059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.245027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.245854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.246645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.383709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.392273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.393919 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.395142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ba28f350-aade-4f72-b110-f2ff5ddaa46d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.166059 Aug 24 03:56:16.395721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 602/1171] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:16 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:16.584697 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:16.585339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:16.593182 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.593706 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.594169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.594887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:16.595341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:16.595811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:16.732541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:16.740769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e3ceb162-e589-4f58-add7-ba5c579996c5 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.159960 Aug 24 03:56:16.741349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 570/1172] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:16 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:17.420087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.420783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.429005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.429604 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.430141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.431087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.431769 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.433012 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.470014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.589177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.592475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.597635 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.599184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.600381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-48c2b82d-bf62-4544-94a9-cc394c858e5a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.184991 Aug 24 03:56:17.600942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 603/1173] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:17.762649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:17.763282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:17.765421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.766075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=6 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.771499 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.771965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.772400 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.773090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:17.773541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:17.773969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:17.914791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:17.917365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d909b991-a1ff-42e4-bd5c-23925c7f179f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.159131 Aug 24 03:56:17.917936 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 571/1174] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:17 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:18.625436 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.626110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.633485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.634557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.634557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.635384 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.636067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.636502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.773869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.783131 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.784706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:18.785871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d0adb7d2-5e9d-4076-a9b1-6c5924ae5317 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.165073 Aug 24 03:56:18.786471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 604/1175] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:18.938788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:18.939353 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:18.946410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.946915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.947365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:18.948566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:18.949015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:18.949444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.085226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.093803 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8d0dfc9a-d8c1-4bcc-87c8-853571acd254 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.160456 Aug 24 03:56:19.094383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 572/1176] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:18 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:19.811067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:19.811608 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:19.818434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.818917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.819353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.820055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:19.820506 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:19.820933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:19.959638 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.967921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.969514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:19.970921 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e6848166-a72c-4e12-9faf-28acc7891993 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.164391 Aug 24 03:56:19.971478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 605/1177] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:19 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:20.114929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:20.115556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:20.122757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.123237 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.123673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.124364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:20.124816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:20.125243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:20.256908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:20.264884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-19003c4e-d33a-43bb-bb45-b258aaa128b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.153829 Aug 24 03:56:20.265452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 573/1178] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:20 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:20.994164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:20.995426 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:21.002046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.002573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.003120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.003897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.004367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.004801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.138947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.147230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.148806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.150024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c72c169c-94ec-4a9e-bb07-ebd7eb68e23b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1743 microversion: 2.20 time: 0.159859 Aug 24 03:56:21.150627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 606/1179] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:20 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:21.286486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:21.287159 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:21.294231 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.294706 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.295131 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.295815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:21.296260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:21.296678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:21.448951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:21.456997 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-13420bac-7ca2-4a99-8a3d-d262645a26e2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.174376 Aug 24 03:56:21.462541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 574/1180] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:21 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:22.174563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:22.176937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:22.181643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.182347 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.182785 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.183481 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.183939 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.184364 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.317418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:22.326287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:22.327794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:22.328944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ea651581-f338-4086-99d3-65a05413bdf4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1743 microversion: 2.20 time: 0.158400 Aug 24 03:56:22.329483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 607/1181] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:22 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:22.480168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:22.480875 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:22.487424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.487983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.488420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.489111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:22.489568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:22.489992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:22.624863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:22.632623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6aed5f53-c8f8-4804-8867-76dca93fc676 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.157171 Aug 24 03:56:22.633185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 575/1182] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:22 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:23.034243 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-5c69b599-332b-460a-ab56-6ef0256e63ac req-7abccf50-a773-4989-98de-b565ef1c20bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b623ffb6-0e7e-415a-a935-6483fc304ae7", "name": "network-vif-plugged", "status": "completed", "tag": "3b118ff2-c881-4155-9de9-cbf9bda38ef3"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:23.044810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-5c69b599-332b-460a-ab56-6ef0256e63ac req-7abccf50-a773-4989-98de-b565ef1c20bd service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.045292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-5c69b599-332b-460a-ab56-6ef0256e63ac req-7abccf50-a773-4989-98de-b565ef1c20bd service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.045728 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-5c69b599-332b-460a-ab56-6ef0256e63ac req-7abccf50-a773-4989-98de-b565ef1c20bd service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.056828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-5c69b599-332b-460a-ab56-6ef0256e63ac req-7abccf50-a773-4989-98de-b565ef1c20bd service nova] Creating event network-vif-plugged:3b118ff2-c881-4155-9de9-cbf9bda38ef3 for instance b623ffb6-0e7e-415a-a935-6483fc304ae7 on hv-cinder-85425 Aug 24 03:56:23.064071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-5c69b599-332b-460a-ab56-6ef0256e63ac req-7abccf50-a773-4989-98de-b565ef1c20bd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031611 Aug 24 03:56:23.064071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 608/1183] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:23.353390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:23.354744 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:23.361303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.367043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.367043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.367043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.367043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.367432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.503283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.513069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.514614 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.515790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7701506f-a5a0-42e3-8998-0a23591af732 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1743 microversion: 2.20 time: 0.166612 Aug 24 03:56:23.516354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 576/1184] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:23 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:23.656194 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:23.656905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:23.671524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.672013 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.672449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.673154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:23.673612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:23.674116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:23.817252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:23.825554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-436fa272-46c8-460a-95ad-f61d12ec971b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.175000 Aug 24 03:56:23.826303 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 609/1185] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:23 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:24.539128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.539776 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.546120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.546705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.547144 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.547905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.548362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.548780 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.692844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.705072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.706378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:24.707567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dac092d3-93ca-47d3-820a-ce16c372c2fe tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.172449 Aug 24 03:56:24.708181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 577/1186] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:24.848325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:24.849331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:24.857280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.857854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.858395 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:24.859166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:24.859802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:24.860456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.043060 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.059488 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-34235d71-2d7f-4e5a-84c6-16c61fd752ec tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1265 microversion: 2.1 time: 0.216022 Aug 24 03:56:25.060210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 610/1187] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:24 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:25.732365 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:25.733031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:25.739843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.740514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.741139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.741842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:25.742331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:25.742762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:25.902870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.912238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.913794 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:25.915061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-45e29613-c24a-43a3-a2cc-cb388303b954 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.186856 Aug 24 03:56:25.915615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 578/1188] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:25 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:26.083463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.084181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.091602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.092412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.093109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.093909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.094702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.095400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.263558 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.278575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f75f0d7c-e197-4212-b76a-01c271a112ca tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1451 microversion: 2.1 time: 0.198890 Aug 24 03:56:26.279860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 611/1189] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1451 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:56:26.301044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.301721 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.308602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.309364 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.309992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.310998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.311890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.312517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.469669 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:26.478241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4c8ad994-994c-487b-81e5-3880011bc6f0 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1451 microversion: 2.1 time: 0.181170 Aug 24 03:56:26.493243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 579/1190] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1451 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:56:26.942812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:26.943633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:26.951944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.952820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.953662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:26.955038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:26.955776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:26.966634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.056891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-5c771b11-d41a-4f39-81f2-2e1a0a627e06 req-02e4f5c1-341e-4f4c-ae18-91f9ddbf22ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "name": "network-vif-plugged", "status": "completed", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:27.078213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5c771b11-d41a-4f39-81f2-2e1a0a627e06 req-02e4f5c1-341e-4f4c-ae18-91f9ddbf22ec service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:27.080646 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5c771b11-d41a-4f39-81f2-2e1a0a627e06 req-02e4f5c1-341e-4f4c-ae18-91f9ddbf22ec service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:27.081846 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5c771b11-d41a-4f39-81f2-2e1a0a627e06 req-02e4f5c1-341e-4f4c-ae18-91f9ddbf22ec service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:27.109804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-5c771b11-d41a-4f39-81f2-2e1a0a627e06 req-02e4f5c1-341e-4f4c-ae18-91f9ddbf22ec service nova] Creating event network-vif-plugged:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:56:27.120336 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-5c771b11-d41a-4f39-81f2-2e1a0a627e06 req-02e4f5c1-341e-4f4c-ae18-91f9ddbf22ec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067782 Aug 24 03:56:27.124586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 580/1191] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:56:27.247292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.258064 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.259756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:27.261620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-89c593f3-fa9e-415d-8315-1a3edcec3426 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.325135 Aug 24 03:56:27.262471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 612/1192] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:26 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:28.288284 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:28.289149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:28.304805 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.305283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.305716 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.306442 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.306890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.307318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.458713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:28.467774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:28.469289 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:28.470504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1c6c10fa-4d41-4bc0-9e9b-e4bbfcd022c7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.187155 Aug 24 03:56:28.471064 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 581/1193] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:28 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:28.849528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:28.851223 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:28.865149 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.866801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.867940 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.869516 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:28.870232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:28.872946 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:28.905265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5fb7c68e-ddfd-421e-893c-466ce29f29d0 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/ips" status: 200 len: 147 microversion: 2.1 time: 0.070219 Aug 24 03:56:28.906044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 613/1194] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:56:28 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/ips => generated 147 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:29.253770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-afe7529a-ee85-4a4f-bf16-d8fe0e285d60 req-df1ca717-9a2a-48d3-83c4-1e47c9b30e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b623ffb6-0e7e-415a-a935-6483fc304ae7", "tag": "3b118ff2-c881-4155-9de9-cbf9bda38ef3"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:29.264401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-afe7529a-ee85-4a4f-bf16-d8fe0e285d60 req-df1ca717-9a2a-48d3-83c4-1e47c9b30e85 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.265107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-afe7529a-ee85-4a4f-bf16-d8fe0e285d60 req-df1ca717-9a2a-48d3-83c4-1e47c9b30e85 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.265692 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-afe7529a-ee85-4a4f-bf16-d8fe0e285d60 req-df1ca717-9a2a-48d3-83c4-1e47c9b30e85 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.277939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-afe7529a-ee85-4a4f-bf16-d8fe0e285d60 req-df1ca717-9a2a-48d3-83c4-1e47c9b30e85 service nova] Creating event network-changed:3b118ff2-c881-4155-9de9-cbf9bda38ef3 for instance b623ffb6-0e7e-415a-a935-6483fc304ae7 on hv-cinder-85425 Aug 24 03:56:29.283437 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-afe7529a-ee85-4a4f-bf16-d8fe0e285d60 req-df1ca717-9a2a-48d3-83c4-1e47c9b30e85 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Aug 24 03:56:29.284638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 582/1195] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:29.503267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:29.503906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:29.516693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.517889 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.518396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.519680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:29.520146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:29.520758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:29.874519 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.892746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.892746 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:29.894869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0dd57fe9-9e2d-4b5f-8240-2a1852f343ba tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.401656 Aug 24 03:56:29.900495 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 614/1196] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:29 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:30.924358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a0abb08-58cd-419e-8890-2ee05335ab07"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:30.927818 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.930287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:30.931137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:30.936454 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.938175 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.938828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.939059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.939759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.939960 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.940526 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.940653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.941161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:30.941808 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:30.942443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:30.946632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:31.161804 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:31.176200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:31.180910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:31.182991 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-80f27333-6bb3-4ccd-8603-d0ad2a7d87b0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.256743 Aug 24 03:56:31.183892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 615/1197] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:30 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:32.206600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:32.207270 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:32.213817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:32.214366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:32.214821 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:32.215513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:32.215965 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:32.216461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:32.354944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:32.363910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:32.365404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:32.366579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2ca7a404-d1b0-474b-8114-d2d8469dab20 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.163840 Aug 24 03:56:32.367221 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 616/1198] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:32 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:32.367860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0ea8f6e5-bda6-4e34-800a-2a8f92f8dd06 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.450692 Aug 24 03:56:32.368532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 583/1199] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:56:30 2022] POST /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 194 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:33.392150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:33.393531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:33.400350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.401084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.401877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.403034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:33.403566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:33.404032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:33.602245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:33.614568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:33.616668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:33.618238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3f356903-884c-4c32-a04d-fc3ef5187302 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.231729 Aug 24 03:56:33.619729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 617/1200] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:33 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:34.645618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:34.646581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:34.653545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.654322 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.654840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.655714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:34.656434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:34.656873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:34.821817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:34.837773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:34.839832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:34.841329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dd282fbc-c17e-4c45-865d-efac9b2956e1 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.203158 Aug 24 03:56:34.843714 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 584/1201] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:34 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:35.864849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:35.866097 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:35.873462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.873958 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.874424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:35.876511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:35.877281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:35.877918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:36.087678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:36.099307 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:36.100903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:36.102068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7e844256-9438-48ed-986d-b9031722759e tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.241114 Aug 24 03:56:36.114556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 618/1202] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:35 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:37.126002 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:37.126743 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:37.128651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:37.133270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.133746 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.134202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.134890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:37.135341 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:37.135766 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:37.271755 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:37.280690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:37.282245 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:37.283407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6b191849-29cb-4bf6-81f3-f4e5adc1c9bf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1738 microversion: 2.20 time: 0.162120 Aug 24 03:56:37.283962 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 585/1203] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:37 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:38.307838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:38.308447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:38.315822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.316312 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.316967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.317691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:38.318182 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:38.318725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:38.539660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.549842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.553735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:38.553735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f1c81567-6fae-4857-a993-02434705aea3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1720 microversion: 2.20 time: 0.248805 Aug 24 03:56:38.553735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 619/1204] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:38 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:39.578022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:39.578724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:39.585519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.591363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.591363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.591363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:39.591363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:39.591919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:39.607848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:39.727869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.736757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.738266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:39.741711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-14260208-ff54-4ddb-8316-0bde4e2e07f8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1720 microversion: 2.20 time: 0.166525 Aug 24 03:56:39.741711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 586/1205] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:39 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:40.763379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:40.763993 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:40.766540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=56 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:40.771361 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.771839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.772274 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.772961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:40.773412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:40.773838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:40.918036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.934129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.935900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:40.937111 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-20a27873-a6df-422a-ae87-d8de490052d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1720 microversion: 2.20 time: 0.177903 Aug 24 03:56:40.937740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 620/1206] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:40 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:41.001901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-6b194bd5-ebb2-4bb9-8c0c-cac3d1b8531b req-ea104e30-7f0f-411e-8260-61786a3c8936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "name": "network-vif-unplugged", "status": "completed", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:41.019507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-6b194bd5-ebb2-4bb9-8c0c-cac3d1b8531b req-ea104e30-7f0f-411e-8260-61786a3c8936 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.019988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-6b194bd5-ebb2-4bb9-8c0c-cac3d1b8531b req-ea104e30-7f0f-411e-8260-61786a3c8936 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.020469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-6b194bd5-ebb2-4bb9-8c0c-cac3d1b8531b req-ea104e30-7f0f-411e-8260-61786a3c8936 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.034559 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-6b194bd5-ebb2-4bb9-8c0c-cac3d1b8531b req-ea104e30-7f0f-411e-8260-61786a3c8936 service nova] Creating event network-vif-unplugged:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:56:41.040038 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-6b194bd5-ebb2-4bb9-8c0c-cac3d1b8531b req-ea104e30-7f0f-411e-8260-61786a3c8936 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055896 Aug 24 03:56:41.040630 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 587/1207] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:41.965739 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:41.966619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:41.974095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.974863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.975492 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.976209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:41.977051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:41.977574 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:41.997730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=100 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:42.110527 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.118610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.123552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:42.123552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-043e051a-c37f-4889-90c0-36fdd99bbb0d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1723 microversion: 2.20 time: 0.160026 Aug 24 03:56:42.123552 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 621/1208] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:41 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:42.145756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3adf3ad0-be0b-4a5b-8846-c2fa443ce571"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:42.148249 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:42.155480 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.155965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.156406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:42.157101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:42.157557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:42.157987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.094609 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3a5bb218-e576-421f-ac9a-ca82c90425a2 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.953850 Aug 24 03:56:43.095547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 588/1209] 10.222.0.65 () {62 vars in 1364 bytes} [Wed Aug 24 03:56:42 2022] POST /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-volume_attachments => generated 188 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:56:43.128593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.130902 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.144499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.145005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.145474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.147974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.147974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.147974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.182998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-89d79537-5bc4-4999-9af2-40cea6f57ff5 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056365 Aug 24 03:56:43.182998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 622/1210] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:56:43 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:43.193015 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.193534 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.201165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.207517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.207517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.207517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.207517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.208042 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.235621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8c4de736-1abf-4a28-8275-7ba050af72fd tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/2a0abb08-58cd-419e-8890-2ee05335ab07" status: 200 len: 194 microversion: 2.1 time: 0.046952 Aug 24 03:56:43.236331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 589/1211] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 24 03:56:43 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/2a0abb08-58cd-419e-8890-2ee05335ab07 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:43.247084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:43.247585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.253616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.254311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.254753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.256178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.256641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.257071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.906238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4dffd8c6-d70d-4504-a298-b4b9ae95b9e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-volume_attachments/3adf3ad0-be0b-4a5b-8846-c2fa443ce571" status: 202 len: 0 microversion: 2.20 time: 0.662959 Aug 24 03:56:43.906841 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 623/1212] 10.222.0.65 () {60 vars in 1457 bytes} [Wed Aug 24 03:56:43 2022] DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-volume_attachments/3adf3ad0-be0b-4a5b-8846-c2fa443ce571 => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:56:43.968643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:43.969236 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:43.975167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.975644 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.976074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:43.976754 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:43.977197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:43.977615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.008307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127736) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:56:44.296168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dfd679ea-7603-48fb-83c8-4517bcb049f3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "POST /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/action" status: 202 len: 0 microversion: 2.20 time: 0.331110 Aug 24 03:56:44.296951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 590/1213] 10.222.0.65 () {62 vars in 1319 bytes} [Wed Aug 24 03:56:43 2022] POST /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:56:44.305023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:44.305632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:44.312731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:44.313216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:44.313657 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.314380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:44.314845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:44.315350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.446918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:44.455473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:44.457003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:44.458433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-67c7ddae-2533-40e8-9b9b-9bc744d9493c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1671 microversion: 2.20 time: 0.157449 Aug 24 03:56:44.458982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 624/1214] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:44 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:44.916916 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a7b30bb-8a00-44eb-a081-5a09138cf86c"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:44.919329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:44.927108 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:44.927673 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:44.928186 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:44.928954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:44.929501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:44.929996 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.482127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:45.482877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:45.489613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.490098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.490573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.491272 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:45.491725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:45.492184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:45.635817 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:45.644577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:45.646213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:45.647708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0a714c15-e6d3-4a22-b012-0648a24454ae tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1671 microversion: 2.20 time: 0.169774 Aug 24 03:56:45.648415 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 625/1215] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:45 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:45.933415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e337f181-119b-433d-bbce-88f7ea5c2c41 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "POST /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020328 Aug 24 03:56:45.939372 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 591/1216] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:56:44 2022] POST /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 194 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:46.673051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:46.673652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:46.680579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.680997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.681453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.682176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:46.682633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:46.683060 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:46.820212 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:46.828663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:46.830193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:46.831355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6cc680bb-84b6-4d55-a5b9-b497c3a7c8e0 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.162994 Aug 24 03:56:46.831918 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 626/1217] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:46 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:47.857424 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:47.858591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:47.865316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.865801 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.866264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:47.866957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:47.867401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:47.867823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:48.001029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.009522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.011075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:48.012246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-77723606-589c-4765-bd74-2767b420e2f4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.159812 Aug 24 03:56:48.012806 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 592/1218] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:47 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:49.035505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:49.036080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:49.042938 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.043425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.043866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.044574 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:49.045032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:49.045476 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:49.189478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.199219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.200867 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:49.202933 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a7b4951f-13cb-4f9f-801d-783b08c4aa37 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.171559 Aug 24 03:56:49.203550 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 627/1219] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:49 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:50.227107 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:50.227719 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:50.234912 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.235627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.236072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.236771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:50.237224 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:50.237655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:50.373913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.382585 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.384146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:50.385330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6827026e-1dc2-4ac9-9b22-002b5983ff4c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.162412 Aug 24 03:56:50.385886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 593/1220] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:50 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:51.409281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:51.410001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:51.416633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.417142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.417595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.418503 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:51.418912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:51.419358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:51.556024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:51.564668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:51.566228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:51.567403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-59c076f4-6bf4-497d-9efa-bb745a01548f tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.162663 Aug 24 03:56:51.574878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 628/1221] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:51 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:52.591831 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:52.592976 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:52.600006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:52.600567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:52.601005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:52.601789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:52.602401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:52.602828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:52.745010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.753972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.755826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:52.757005 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8038d9c3-d499-420e-a64d-af8a075ddf9c tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.169237 Aug 24 03:56:52.757556 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 594/1222] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:52 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:53.780747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:53.781563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:53.787929 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.788446 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.788887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.789595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:53.790082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:53.790537 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:53.928633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.938056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.939648 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:53.940828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0bb908a2-bbaf-4e22-8b8d-e392211cbe97 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.164232 Aug 24 03:56:53.941417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 629/1223] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:53 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:54.964905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:54.964905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:54.972031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.972845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.973624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:54.974782 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:54.975405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:54.975915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:55.126993 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:55.135327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:55.136843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:55.138004 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9da29b61-c528-42b7-96dd-f567d1760489 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.178225 Aug 24 03:56:55.138593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 595/1224] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:54 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:56.161439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:56.162201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:56.168828 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.169393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.169845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.171256 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.171720 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.172152 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.312179 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:56.321305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:56.322844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:56.324015 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-58b56690-276f-4019-b23e-9d3f5e857139 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.166524 Aug 24 03:56:56.324936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 630/1225] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:56 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:56.518596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:56.519174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:56.526006 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.526599 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.527149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.527898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:56.528354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:56.528933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:56.554858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a0f45eb0-4312-4230-9e63-bb881a7b8633 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/ips" status: 200 len: 150 microversion: 2.1 time: 0.041048 Aug 24 03:56:56.555453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 596/1226] 10.222.0.65 () {58 vars in 1248 bytes} [Wed Aug 24 03:56:56 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:56:57.350204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:57.366164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:57.375312 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:57.377107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:57.377553 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:57.378400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:57.378846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:57.379456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:57.524870 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.533990 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.536020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:57.536848 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d151b246-10ee-4d08-9929-b454ffee9d83 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.191385 Aug 24 03:56:57.537616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 631/1227] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:57 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:56:58.380901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f39019d6-228b-4be0-b4f4-e8029849eb09"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:56:58.383495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:58.390983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.395057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.395057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.395057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.395057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.395743 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.561945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:58.562831 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:58.569087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.569585 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.570020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.570758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:58.571217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:58.571710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:58.724997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.735244 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.736879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:58.738071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fbd8a6df-5034-44b4-8925-e0ba760151cc tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.181163 Aug 24 03:56:58.750452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 632/1228] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:58 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:56:59.763238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:56:59.764013 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:56:59.772554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.773089 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.773565 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.774366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:56:59.774920 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:56:59.775630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:56:59.919856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.928813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.930351 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:56:59.931511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-66e21dfe-c12c-43bc-b587-7f793366842b tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.172224 Aug 24 03:56:59.932199 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 633/1229] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:56:59 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:00.884804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:00.957201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:00.957818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:00.964322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.964809 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.965315 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:00.966020 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:00.966501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:00.968696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:01.002318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6295a4e9-88b5-4ea3-b14e-be3a3b4f0857 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "POST /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.625462 Aug 24 03:57:01.002859 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 597/1230] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 03:56:58 2022] POST /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments => generated 194 bytes in 2627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:01.352132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.361762 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.363333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:01.364504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f6f5366e-62e9-4637-97b3-e4639eeae205 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.411252 Aug 24 03:57:01.365125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 634/1231] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:00 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:02.395398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:02.396083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:02.403051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.403473 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.403904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.404595 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:02.405375 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:02.406055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:02.540657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.549434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.550981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:02.552123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-24f3c815-1596-455d-b88c-7ffd7b1f0ccf tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.161587 Aug 24 03:57:02.552680 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 598/1232] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:02 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:03.072981 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.075262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.082678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.083158 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.083589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.084279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.084726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.085148 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.111559 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:03.116702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7bfccc52-a57b-44fd-9fe1-b3e7f84e721c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047709 Aug 24 03:57:03.117540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 635/1233] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:57:03.268571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.269135 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.275105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.275588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.276024 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.276728 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.277185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.277612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.307618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1a2a3205-270a-40d2-803f-aa5c9f71a90f tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/2a0abb08-58cd-419e-8890-2ee05335ab07" status: 200 len: 194 microversion: 2.1 time: 0.043575 Aug 24 03:57:03.308228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 599/1234] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/2a0abb08-58cd-419e-8890-2ee05335ab07 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:03.319765 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.321524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.327731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.328209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.328650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.329338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.329790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.330249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.410844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lazy-loading 'services' on Instance uuid 9b025db2-3af4-4945-89af-46d94652c12e {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:03.576918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:03.577922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:03.584479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.584954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.585382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.586063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:03.586535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:03.586957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:03.615163 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f3786652-305b-49d0-bc37-b2af74904713 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/2a0abb08-58cd-419e-8890-2ee05335ab07" status: 202 len: 0 microversion: 2.1 time: 0.299191 Aug 24 03:57:03.615752 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 636/1235] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:03 2022] DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/2a0abb08-58cd-419e-8890-2ee05335ab07 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:03.729417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.738784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.740309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:03.741468 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c36c2c21-b55a-4002-8855-a8e36a6854e7 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.169188 Aug 24 03:57:03.742028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 600/1236] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:03 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:57:04.765631 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:04.766353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:04.772941 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:04.773412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:04.773844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:04.774555 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:04.774998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:04.775419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:04.903759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:04.912525 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:04.914029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:04.915201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ba2c9a6d-2a3d-4089-9103-eda640326312 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.154197 Aug 24 03:57:04.915753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 637/1237] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:04 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:05.141618 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-fb74c185-0af7-476b-8092-d88c44b1e67a req-b242bdb3-7fb5-49b7-bf73-1d93fcd413fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "name": "network-vif-plugged", "status": "completed", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:05.151354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-fb74c185-0af7-476b-8092-d88c44b1e67a req-b242bdb3-7fb5-49b7-bf73-1d93fcd413fc service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.151832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-fb74c185-0af7-476b-8092-d88c44b1e67a req-b242bdb3-7fb5-49b7-bf73-1d93fcd413fc service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.152269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-fb74c185-0af7-476b-8092-d88c44b1e67a req-b242bdb3-7fb5-49b7-bf73-1d93fcd413fc service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.163605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-fb74c185-0af7-476b-8092-d88c44b1e67a req-b242bdb3-7fb5-49b7-bf73-1d93fcd413fc service nova] Creating event network-vif-plugged:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:57:05.168525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-fb74c185-0af7-476b-8092-d88c44b1e67a req-b242bdb3-7fb5-49b7-bf73-1d93fcd413fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031218 Aug 24 03:57:05.169316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 601/1238] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:05.939359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:05.940013 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:05.946360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.946846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.947317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:05.948010 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:05.948465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:05.948922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:06.083932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:06.092607 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:06.094129 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:06.095310 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-45d36fd9-39b6-447f-94bd-136530a47553 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.160044 Aug 24 03:57:06.095869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 638/1239] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:05 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:07.119761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:07.120496 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:07.132969 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.134024 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.134024 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.134569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:07.135014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:07.135435 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:07.270384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.278520 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.281000 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:07.282164 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fd8a0d57-e664-4ea2-b4a4-d6482beb3108 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.167610 Aug 24 03:57:07.286376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 602/1240] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:07 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:08.306861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:08.307485 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:08.314136 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.314653 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.315098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.315927 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:08.316385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:08.316819 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:08.459409 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:08.469185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:08.471547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:08.472707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a064ff09-2499-433f-b3f5-08fc04eb7598 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1729 microversion: 2.20 time: 0.169869 Aug 24 03:57:08.473258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 639/1241] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:08 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:09.495965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:09.496619 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:09.504035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:09.504516 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:09.504952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:09.505649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:09.506328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:09.506537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:09.647392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:09.655606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:09.657115 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:09.658325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-009f5f30-a6f8-447f-b8bc-82587015c80d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1716 microversion: 2.20 time: 0.166476 Aug 24 03:57:09.662924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 603/1242] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:57:09 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:57:10.774759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:10.775249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:10.781826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.782338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.782782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.783471 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:10.784144 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:10.784885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:10.866007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'services' on Instance uuid df82cb36-fb91-4829-8c75-2d7c94d74eef {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:11.082651 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c1aa68df-e8a4-48fa-9351-d55b219519d4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments/f39019d6-228b-4be0-b4f4-e8029849eb09" status: 202 len: 0 microversion: 2.1 time: 0.311778 Aug 24 03:57:11.083430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 640/1243] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:10 2022] DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments/f39019d6-228b-4be0-b4f4-e8029849eb09 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:11.092580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:11.096253 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:11.102962 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:11.105140 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.105676 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.106121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.106851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:11.107302 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:11.107732 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:11.145344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6ae49e64-038f-4858-b72c-03ba8598acac tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057491 Aug 24 03:57:11.145911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 604/1244] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:11 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:12.142509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.143726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.146826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=42 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:12.151005 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.151832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.152475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.153380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.154034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.154668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.159464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.167094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.169951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.170470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.170920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.171617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.173545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.174203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.193645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a0b94106-cf4b-4e70-af50-f80b487eb05c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/6a7b30bb-8a00-44eb-a081-5a09138cf86c" status: 200 len: 194 microversion: 2.1 time: 0.056978 Aug 24 03:57:12.194614 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 641/1245] 10.222.0.65 () {58 vars in 1413 bytes} [Wed Aug 24 03:57:12 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/6a7b30bb-8a00-44eb-a081-5a09138cf86c => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:12.205451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:12.206014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:12.209924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c556f93b-8f7f-458a-a7c7-aaf0f9434b77 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056832 Aug 24 03:57:12.210765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 605/1246] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:12 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:12.212364 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.212844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.213343 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.214054 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:12.214529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:12.214947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:12.297740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lazy-loading 'services' on Instance uuid 9b025db2-3af4-4945-89af-46d94652c12e {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:12.477143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-67c4a34b-fc52-4004-8755-a9348a44cac7 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/6a7b30bb-8a00-44eb-a081-5a09138cf86c" status: 202 len: 0 microversion: 2.1 time: 0.276282 Aug 24 03:57:12.477737 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 642/1247] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 03:57:12 2022] DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments/6a7b30bb-8a00-44eb-a081-5a09138cf86c => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:57:13.223735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:13.225873 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:13.232756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.233235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.233675 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.235069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.235741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.236167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.264890 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-10d866c7-ce4e-4586-8ce8-ff189393ae17 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046307 Aug 24 03:57:13.265446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 606/1248] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:13 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:13.329647 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:13.330259 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:13.337373 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.337677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.339040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.339040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.339391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.339825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.366582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:13.683066 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-fa30a391-dbf3-4d69-9d3f-0c0f7b662315 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 204 len: 0 microversion: 2.1 time: 0.357295 Aug 24 03:57:13.683655 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 643/1249] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:13 2022] DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:13.692428 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:13.693108 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:13.699110 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.699594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.700031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.700756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:13.701211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:13.701638 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:13.832894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:13.840726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4dee1baf-bd10-4eb2-a70c-289eef35ca79 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1680 microversion: 2.1 time: 0.152891 Aug 24 03:57:13.841294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 607/1250] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:13 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:14.706504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:14.708822 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:14.716627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.717330 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.718288 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.719668 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.720300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.720886 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.753725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d244c692-f00e-4eb0-ae8b-38ba7476c42e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Aug 24 03:57:14.754304 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 644/1251] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:14 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:14.863830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:14.864436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:14.870853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.871333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.871761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:14.872446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:14.872891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:14.873337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.005612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:15.013309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-123b0664-0e3e-4b2f-a75e-6ba65d0321e2 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1680 microversion: 2.1 time: 0.154297 Aug 24 03:57:15.013867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 608/1252] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:14 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:15.767138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.769225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.775674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.776154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.776595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.777287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.777747 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.778200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.806788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bc7a6daa-b2fc-4007-8677-80b835dd7de6 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044478 Aug 24 03:57:15.807342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 645/1253] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:15 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:15.919788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:15.922524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:15.928851 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.929333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.929773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.930502 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:15.930955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:15.931380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:15.960988 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7a490b8e-d97c-44e4-80de-b3516275c1ef tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045120 Aug 24 03:57:15.961544 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 609/1254] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 03:57:15 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 03:57:16.026911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.027331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.034034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.034535 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.034961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.035465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.035646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.036093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.036273 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.036511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.042334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.042893 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.043342 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.044037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.044491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.044921 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.062096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:57:16.178691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.186940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1bd924d8-9edd-4757-a75d-75d0209fed18 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1680 microversion: 2.1 time: 0.155978 Aug 24 03:57:16.187545 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 610/1255] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:16 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:57:16.316062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-af0009bf-6314-469f-be7d-6e74e22f6806 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 204 len: 0 microversion: 2.1 time: 0.292627 Aug 24 03:57:16.316581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 646/1256] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:16 2022] DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:57:16.330975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:16.331591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:16.337661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.338197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.338613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.339306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:16.339761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:16.340197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:16.470753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:16.478459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-754aec23-1f4b-4db0-879b-9e116daef721 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1674 microversion: 2.1 time: 0.152054 Aug 24 03:57:16.479286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 611/1257] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:16 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:17.209084 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:17.209792 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.216255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.216738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.217179 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.217882 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.218462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.219386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.223486 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=5,nova_cell1:UPDATE=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:17.355206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:17.363897 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7d86b26a-6f0e-4390-aab0-16ad26ab285f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1680 microversion: 2.1 time: 0.159190 Aug 24 03:57:17.364472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 647/1258] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:17 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:17.500973 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:17.501570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:17.508080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.508560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.508992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.509677 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:17.510124 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:17.510573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:17.643031 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:17.650610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-afd47e42-7c55-4371-aa91-74fc745d473e tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1674 microversion: 2.1 time: 0.154024 Aug 24 03:57:17.651168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 612/1259] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:17 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:18.385836 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:18.386480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:18.393805 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.394313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.394753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.395451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.395906 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.396332 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.529849 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:18.538053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f0c17c8e-1312-4e92-ace4-dd92cfb35f8c tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1680 microversion: 2.1 time: 0.156184 Aug 24 03:57:18.538777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 648/1260] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:18 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:18.673311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:18.673870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:18.680201 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.680681 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.681117 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.688192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:18.688192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:18.688192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:18.817225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:18.824908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-05c239e6-598d-49ed-8bc1-f032392c4808 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1674 microversion: 2.1 time: 0.156244 Aug 24 03:57:18.825475 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 613/1261] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:18 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:19.560799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:19.562861 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:19.571790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.572289 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.572734 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.573447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.573903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.574368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.640306 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:19.649334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-08a8db34-21b3-4964-b1bc-1665b0075708 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1614 microversion: 2.1 time: 0.093638 Aug 24 03:57:19.649951 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 649/1262] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:19 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:19.837491 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-5cd97eeb-bc11-4299-bae3-89ed90c1de1b req-6c5eb8c6-ea75-4e3b-9613-9e5b6f31d5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df82cb36-fb91-4829-8c75-2d7c94d74eef", "name": "network-vif-deleted", "tag": "72e2dfbe-8467-4850-ba3f-131944e3adbd"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:19.850620 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5cd97eeb-bc11-4299-bae3-89ed90c1de1b req-6c5eb8c6-ea75-4e3b-9613-9e5b6f31d5dc service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.851388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5cd97eeb-bc11-4299-bae3-89ed90c1de1b req-6c5eb8c6-ea75-4e3b-9613-9e5b6f31d5dc service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.852338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-5cd97eeb-bc11-4299-bae3-89ed90c1de1b req-6c5eb8c6-ea75-4e3b-9613-9e5b6f31d5dc service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.852786 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:19.853749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:19.865536 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.866037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.866725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-5cd97eeb-bc11-4299-bae3-89ed90c1de1b req-6c5eb8c6-ea75-4e3b-9613-9e5b6f31d5dc service nova] Creating event network-vif-deleted:72e2dfbe-8467-4850-ba3f-131944e3adbd for instance df82cb36-fb91-4829-8c75-2d7c94d74eef on hv-cinder-85425 Aug 24 03:57:19.871257 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.872189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-5cd97eeb-bc11-4299-bae3-89ed90c1de1b req-6c5eb8c6-ea75-4e3b-9613-9e5b6f31d5dc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038461 Aug 24 03:57:19.872349 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:19.872733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:19.873174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:19.877647 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 614/1263] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:20.137797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:20.149380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9318caf-75c7-4b99-b7d2-d2026fe5c55c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1674 microversion: 2.1 time: 0.304940 Aug 24 03:57:20.150197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 650/1264] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:19 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1674 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:20.672768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:20.681731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:20.693791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.694405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.694919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.695693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.696222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.696738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.743961 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.744568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.745264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.745933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lazy-loading 'fault' on Instance uuid df82cb36-fb91-4829-8c75-2d7c94d74eef {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:57:20.753421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=100 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:20.801113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b4b56f008c44c081130377cf8ce630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7520af1ae14ad28eec126353eaac53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:20.809387 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8ad3a35c-5524-4897-b39e-6454edda0499 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 200 len: 1331 microversion: 2.1 time: 0.140754 Aug 24 03:57:20.810370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 615/1265] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:20 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:20.965185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-b86ed6c5-d175-4b28-af8a-a0f1b066c89b req-5bf93e1c-b485-4ff7-84d4-1a37874ed4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b025db2-3af4-4945-89af-46d94652c12e", "name": "network-vif-deleted", "tag": "4769f633-b48b-4b72-b906-80999f75554f"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:57:20.977425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-b86ed6c5-d175-4b28-af8a-a0f1b066c89b req-5bf93e1c-b485-4ff7-84d4-1a37874ed4b3 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:20.978328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-b86ed6c5-d175-4b28-af8a-a0f1b066c89b req-5bf93e1c-b485-4ff7-84d4-1a37874ed4b3 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:20.979206 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-b86ed6c5-d175-4b28-af8a-a0f1b066c89b req-5bf93e1c-b485-4ff7-84d4-1a37874ed4b3 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:20.994062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-b86ed6c5-d175-4b28-af8a-a0f1b066c89b req-5bf93e1c-b485-4ff7-84d4-1a37874ed4b3 service nova] Creating event network-vif-deleted:4769f633-b48b-4b72-b906-80999f75554f for instance 9b025db2-3af4-4945-89af-46d94652c12e on hv-cinder-85425 Aug 24 03:57:20.998827 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-b86ed6c5-d175-4b28-af8a-a0f1b066c89b req-5bf93e1c-b485-4ff7-84d4-1a37874ed4b3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037337 Aug 24 03:57:20.999758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 651/1266] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:57:21.171388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.172037 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:21.179356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.179845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.180284 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.180984 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.181436 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.181862 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.249298 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f4991f9c6ca4fc99f756f75f9460808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaf4ab3fd764ce88e7af0dbc3e6601e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:57:21.258320 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-074a9781-389e-4817-bc4a-b97174ce9de4 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 200 len: 1321 microversion: 2.1 time: 0.091181 Aug 24 03:57:21.259735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 616/1267] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:21 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:57:21.834225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.834928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:21.841212 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.841885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.842313 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.843240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:21.843755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:21.844204 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:21.860732 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef HTTP/1.1 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:21.863279 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:21.865034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'df82cb36-fb91-4829-8c75-2d7c94d74eef'} Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:21.865806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:21.867147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:21.868271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:21.868271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2e0d4ef4-f63a-498a-9e2e-64674c956305 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 404 len: 111 microversion: 2.1 time: 0.034616 Aug 24 03:57:21.868271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 652/1268] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:21 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:21.873539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-19592f5c-f540-434d-bdc0-bd9ebfd380a8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '.version_select at 0x7f6c18185d30>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:21.975113 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-19592f5c-f540-434d-bdc0-bd9ebfd380a8 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476358237" status: 202 len: 0 microversion: 2.1 time: 0.105223 Aug 24 03:57:21.976022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 617/1269] 10.222.0.65 () {58 vars in 1221 bytes} [Wed Aug 24 03:57:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476358237 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:22.279633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:22.280419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:22.287576 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.288053 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.288491 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.289185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:22.289639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:22.290065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:22.304868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] HTTP exception thrown: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Request method failure captured: Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e HTTP/1.1 Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-QEssHyxlavpg4Vtpb3bDRqSz1WTZHTEFm6noE_ovGozwXPvIhKIoOWUM1P-qbxoHuRVSW3u_eJqyHJfuhD6ilAWjo56SWywDhoRAxbZmMlio6fqkVQsRtyruIdaL4gv3GbtbCH8ljaWrHVu-EAS6W6kGG5n9Ufe3rBa5rc94u7dA Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:22.306460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 7f4991f9c6ca4fc99f756f75f9460808 Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:22.308068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '9b025db2-3af4-4945-89af-46d94652c12e'} Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:22.309035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:22.311723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:22.313018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Returning 404 to user: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:22.313018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1bbc5861-ea9d-4593-8aea-d80577f898b3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 404 len: 111 microversion: 2.1 time: 0.032286 Aug 24 03:57:22.313018 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 653/1270] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:22 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:22.319081 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-30c3b795-2bd7-4d35-91ab-e5e0d652163c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '.version_select at 0x7f6c181ed940>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:22.398905 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-30c3b795-2bd7-4d35-91ab-e5e0d652163c tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280845503" status: 202 len: 0 microversion: 2.1 time: 0.084121 Aug 24 03:57:22.399498 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 618/1271] 10.222.0.65 () {58 vars in 1218 bytes} [Wed Aug 24 03:57:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280845503 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:57:24.146290 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:24.146776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:24.154998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:24.154998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:24.154998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:24.154998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:24.155362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:24.155646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:24.170092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef HTTP/1.1 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:24.171586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.173302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'df82cb36-fb91-4829-8c75-2d7c94d74eef'} Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:24.174238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.175502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.177025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:24.177025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4c7a28de-944f-40f4-8ae5-bf60bd06023e tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 404 len: 111 microversion: 2.1 time: 0.031357 Aug 24 03:57:24.177025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 654/1272] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:24 2022] DELETE /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:24.182461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:24.183076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: df82cb36-fb91-4829-8c75-2d7c94d74eef] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:24.189624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:24.190098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:24.190557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:24.191246 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:24.191696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:24.192123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:24.206628 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef HTTP/1.1 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:57:24.208280 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.209871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': 'df82cb36-fb91-4829-8c75-2d7c94d74eef'} Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:24.210741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. Aug 24 03:57:24.212094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:24.213521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance df82cb36-fb91-4829-8c75-2d7c94d74eef could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:24.213521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0f862978-658a-483a-9664-3230e59ba668 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef" status: 404 len: 111 microversion: 2.1 time: 0.031646 Aug 24 03:57:24.213521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 619/1273] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:24 2022] GET /compute/v2.1/servers/df82cb36-fb91-4829-8c75-2d7c94d74eef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:25.541227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.541721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.548610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.549654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.549772 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.550496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.550945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.551367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.565826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 HTTP/1.1 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:25.567431 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.569132 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0'} Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:25.570095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.571627 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.573174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:25.573174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b82adaf4-222c-4128-8f01-0467ba344eca tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 404 len: 111 microversion: 2.1 time: 0.031622 Aug 24 03:57:25.573174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 655/1274] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:25 2022] DELETE /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:25.577374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.578401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.584841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.585316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.585753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.586477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.586930 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.587355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.601140 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 HTTP/1.1 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:57:25.602672 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.605558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': 'da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0'} Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:25.606558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. Aug 24 03:57:25.608069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.609449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:25.609449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e6d8d2fe-cccd-4dce-a5a3-335710a23cea tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0" status: 404 len: 111 microversion: 2.1 time: 0.030896 Aug 24 03:57:25.609449 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 620/1275] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:25 2022] GET /compute/v2.1/servers/da1e96db-acf0-4a7e-9256-3cb0bcd6a9f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:57:25.614561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.615061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.621041 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.621523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.621961 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.622700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.623159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.623581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.637397 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 HTTP/1.1 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:25.638955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.640577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '928f3671-5aef-464f-8035-cc9ee087a394'} Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:25.641654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.643507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.645075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:25.645075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c9118c18-1d2f-46c8-b829-8b7706afb98f tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 404 len: 111 microversion: 2.1 time: 0.031431 Aug 24 03:57:25.645075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 656/1276] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:25 2022] DELETE /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:25.649147 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.653056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 928f3671-5aef-464f-8035-cc9ee087a394] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.655970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.656486 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.656926 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.657708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.658317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.658753 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.672357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 HTTP/1.1 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:57:25.674633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.676316 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '928f3671-5aef-464f-8035-cc9ee087a394'} Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:25.677150 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. Aug 24 03:57:25.678385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.679903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance 928f3671-5aef-464f-8035-cc9ee087a394 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:25.679903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cee98854-579e-4982-ad0a-73229bde01f4 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394" status: 404 len: 111 microversion: 2.1 time: 0.030916 Aug 24 03:57:25.679903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 621/1277] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:25 2022] GET /compute/v2.1/servers/928f3671-5aef-464f-8035-cc9ee087a394 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:25.866383 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.866878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.872751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.873227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.873685 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.874439 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.874872 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.875305 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.889709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] HTTP exception thrown: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Request method failure captured: Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e HTTP/1.1 Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-QEssHyxlavpg4Vtpb3bDRqSz1WTZHTEFm6noE_ovGozwXPvIhKIoOWUM1P-qbxoHuRVSW3u_eJqyHJfuhD6ilAWjo56SWywDhoRAxbZmMlio6fqkVQsRtyruIdaL4gv3GbtbCH8ljaWrHVu-EAS6W6kGG5n9Ufe3rBa5rc94u7dA Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:25.891281 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 7f4991f9c6ca4fc99f756f75f9460808 Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.893623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '9b025db2-3af4-4945-89af-46d94652c12e'} Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:25.894417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.895972 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.897883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Returning 404 to user: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:25.897883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-19c064d7-d2ad-4240-a7c4-02ead8a67dba tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 404 len: 111 microversion: 2.1 time: 0.031176 Aug 24 03:57:25.897883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 657/1278] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:25 2022] DELETE /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:57:25.902941 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:25.903631 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 9b025db2-3af4-4945-89af-46d94652c12e] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:25.910205 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.910688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.911123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.911810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:25.912261 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:25.912694 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:25.927109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] HTTP exception thrown: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Request method failure captured: Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e HTTP/1.1 Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-QEssHyxlavpg4Vtpb3bDRqSz1WTZHTEFm6noE_ovGozwXPvIhKIoOWUM1P-qbxoHuRVSW3u_eJqyHJfuhD6ilAWjo56SWywDhoRAxbZmMlio6fqkVQsRtyruIdaL4gv3GbtbCH8ljaWrHVu-EAS6W6kGG5n9Ufe3rBa5rc94u7dA Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:57:25.928657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 7f4991f9c6ca4fc99f756f75f9460808 Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.930008 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '9b025db2-3af4-4945-89af-46d94652c12e'} Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:25.930774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. Aug 24 03:57:25.932058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:25.933123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Returning 404 to user: Instance 9b025db2-3af4-4945-89af-46d94652c12e could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:25.933123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b4131837-986c-40cc-8227-79912b5abbff tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e" status: 404 len: 111 microversion: 2.1 time: 0.031164 Aug 24 03:57:25.933123 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 622/1279] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:25 2022] GET /compute/v2.1/servers/9b025db2-3af4-4945-89af-46d94652c12e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:26.965262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:26.965800 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:26.972887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.973371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.973814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.974633 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:26.975093 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:26.975523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:26.989261 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 HTTP/1.1 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:26.990883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:26.992420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '310ace7e-4d39-4d18-853d-8100b1de8bd3'} Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:26.993300 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:26.994830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:26.996350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:26.996350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a30ba3c3-453f-44e1-bb3f-561a67a74f5a tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 404 len: 111 microversion: 2.1 time: 0.030908 Aug 24 03:57:26.996350 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 658/1280] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:26 2022] DELETE /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:27.000777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:27.001688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] [instance: 310ace7e-4d39-4d18-853d-8100b1de8bd3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:27.008342 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.008924 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.009392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.010089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.010583 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.011014 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.024939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] HTTP exception thrown: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Request method failure captured: Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 HTTP/1.1 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-NMIijcMBC2ezAFz3vLwTgkvaLVEQqNDNSmgCNtPUcwpvIv7n3XtFuNU5cIEOJn6wUuyNtlQWhpexN9fCREOAmVj48cw-KWn3e7fluTmNE2YIJec1X_9tc1RktIaFVxrjNvdfwIkES_wfpaUIryDuyx9ggbZqtnsu8oVZfprNPzV4 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:57:27.026529 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f7520af1ae14ad28eec126353eaac53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 8f7520af1ae14ad28eec126353eaac53 Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-21346709 Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 77b4b56f008c44c081130377cf8ce630 Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeNegativeTest-21346709-project Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:27.028177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '310ace7e-4d39-4d18-853d-8100b1de8bd3'} Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:27.029019 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. Aug 24 03:57:27.030328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.031406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] Returning 404 to user: Instance 310ace7e-4d39-4d18-853d-8100b1de8bd3 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:27.031406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-74d406dd-6769-4dfc-a331-b48647f54465 tempest-AttachVolumeNegativeTest-21346709 tempest-AttachVolumeNegativeTest-21346709-project] 10.222.0.65 "GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3" status: 404 len: 111 microversion: 2.1 time: 0.031077 Aug 24 03:57:27.031406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 623/1281] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:26 2022] GET /compute/v2.1/servers/310ace7e-4d39-4d18-853d-8100b1de8bd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:27.216213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:27.216716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:27.222936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.223487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.225788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.225788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.225788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.225788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.240242 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] HTTP exception thrown: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Request method failure captured: Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f HTTP/1.1 Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-QEssHyxlavpg4Vtpb3bDRqSz1WTZHTEFm6noE_ovGozwXPvIhKIoOWUM1P-qbxoHuRVSW3u_eJqyHJfuhD6ilAWjo56SWywDhoRAxbZmMlio6fqkVQsRtyruIdaL4gv3GbtbCH8ljaWrHVu-EAS6W6kGG5n9Ufe3rBa5rc94u7dA Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:57:27.241969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 7f4991f9c6ca4fc99f756f75f9460808 Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.243676 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '2dd163bb-cead-4664-bfcc-59aa1b1f920f'} Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:27.244564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.246048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.247962 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Returning 404 to user: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:27.247962 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-3ff8ea77-5a82-4317-a7fd-09f90260a4c3 tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 404 len: 111 microversion: 2.1 time: 0.031238 Aug 24 03:57:27.247962 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 659/1282] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 03:57:27 2022] DELETE /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:27.255466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:57:27.256092 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] [instance: 2dd163bb-cead-4664-bfcc-59aa1b1f920f] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:57:27.262139 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.262712 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.263146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.263839 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:57:27.264287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:57:27.264709 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:57:27.280835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] HTTP exception thrown: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Request method failure captured: Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f HTTP/1.1 Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-QEssHyxlavpg4Vtpb3bDRqSz1WTZHTEFm6noE_ovGozwXPvIhKIoOWUM1P-qbxoHuRVSW3u_eJqyHJfuhD6ilAWjo56SWywDhoRAxbZmMlio6fqkVQsRtyruIdaL4gv3GbtbCH8ljaWrHVu-EAS6W6kGG5n9Ufe3rBa5rc94u7dA Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:57:27.283202 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbaf4ab3fd764ce88e7af0dbc3e6601e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: dbaf4ab3fd764ce88e7af0dbc3e6601e Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeTestJSON-77798652 Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 7f4991f9c6ca4fc99f756f75f9460808 Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeTestJSON-77798652-project Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.284580 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '2dd163bb-cead-4664-bfcc-59aa1b1f920f'} Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:57:27.285325 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. Aug 24 03:57:27.287017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:57:27.288439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] Returning 404 to user: Instance 2dd163bb-cead-4664-bfcc-59aa1b1f920f could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:57:27.288439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-647c6091-349a-40aa-b223-c6249c64ddbe tempest-AttachVolumeTestJSON-77798652 tempest-AttachVolumeTestJSON-77798652-project] 10.222.0.65 "GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f" status: 404 len: 111 microversion: 2.1 time: 0.033157 Aug 24 03:57:27.288439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 624/1283] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:57:27 2022] GET /compute/v2.1/servers/2dd163bb-cead-4664-bfcc-59aa1b1f920f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:58:04.213546 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.218682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.218682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:04.218682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=41 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:04.223164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.223639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.224068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.224754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.225200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.225698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.255580 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5e7b2961-4b03-4439-b41c-8f457f230d87 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046444 Aug 24 03:58:04.258693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 660/1284] 10.222.0.65 () {60 vars in 1343 bytes} [Wed Aug 24 03:58:04 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:04.320218 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.320791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.323211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:04.324067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=20 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:04.338990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.338990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.338990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.338990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.339394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.339394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.356957 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:58:04.682904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-76fcdcaa-8984-4c2d-908a-33fd3e4f97ce tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 204 len: 0 microversion: 2.20 time: 0.366867 Aug 24 03:58:04.683481 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 625/1285] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 03:58:04 2022] DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:58:04.691905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:04.692522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:04.699603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.700087 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.700533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.701230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:04.701687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:04.702119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:04.835200 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.843507 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.845017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:04.846197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-55b13ec6-a8bf-4c12-9dc7-fe4df4df6f98 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.158364 Aug 24 03:58:04.846788 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 661/1286] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:04 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:05.870723 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:05.871418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:05.877869 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.878391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.878828 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:05.879513 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:05.879962 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:05.880391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:06.014053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.022171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.023768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:06.024920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-18584111-7faf-409f-aad3-87a355815a09 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.158577 Aug 24 03:58:06.025477 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 626/1287] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:05 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:07.047573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:07.048108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:07.055517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.056009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.056449 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.057153 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:07.057613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:07.058049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:07.191107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.199988 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.201518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:07.202714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-bc18b85d-3d82-4c94-9038-73d913aee38a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.159273 Aug 24 03:58:07.203269 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 662/1288] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:07 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:08.226922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:08.227617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:08.234860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.235403 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.235842 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.236537 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:08.236987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:08.237417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:08.368087 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.376318 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.377836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:08.380522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6e80e2f5-c78a-4ab3-8e57-b4d72245fdc8 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.157085 Aug 24 03:58:08.380522 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 627/1289] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:08 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:09.401962 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:09.402606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:09.409137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.409628 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.410069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.410856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:09.411335 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:09.418526 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:09.546080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.554263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.556273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:09.557427 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7c8af8f0-01d1-492a-a8cf-03348ff0bd22 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.160071 Aug 24 03:58:09.557980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 663/1290] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:09 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:10.581155 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:10.581767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:10.589243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.590940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.590940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.590940 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:10.591357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:10.591789 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:10.719153 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.728299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.729819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:10.731009 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0da3f29c-234a-4c4c-9174-16a7aa3dc1d4 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.153887 Aug 24 03:58:10.731564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 628/1291] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:10 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:11.755001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:11.755573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:11.761966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.762483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.762928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.763634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:11.764090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:11.764523 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:11.895103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.903907 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.905417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:11.906608 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4e40cf58-a694-4e16-ab44-20e3464e35e3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.155618 Aug 24 03:58:11.907161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 664/1292] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:11 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:12.930897 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:12.931516 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:12.938319 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.939010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.939450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:12.940317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:12.940939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:12.941426 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.149632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.158338 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.159901 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:13.161133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-33583e10-c884-4c19-bd92-bb6321c7178d tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1722 microversion: 2.20 time: 0.234926 Aug 24 03:58:13.162340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 629/1293] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:12 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:13.515396 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-de35a76d-d2a8-4780-99dc-c00927d36a04 req-101e9862-14af-4246-8de9-d17988b33d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1edcdfc-1f9f-49fc-9765-88a550b1678b", "name": "network-vif-deleted", "tag": "81955f75-a663-4c77-acf6-f4379e8106ab"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:13.531852 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-de35a76d-d2a8-4780-99dc-c00927d36a04 req-101e9862-14af-4246-8de9-d17988b33d4f service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:13.532606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-de35a76d-d2a8-4780-99dc-c00927d36a04 req-101e9862-14af-4246-8de9-d17988b33d4f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:13.533222 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-de35a76d-d2a8-4780-99dc-c00927d36a04 req-101e9862-14af-4246-8de9-d17988b33d4f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:13.546176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-de35a76d-d2a8-4780-99dc-c00927d36a04 req-101e9862-14af-4246-8de9-d17988b33d4f service nova] Creating event network-vif-deleted:81955f75-a663-4c77-acf6-f4379e8106ab for instance b1edcdfc-1f9f-49fc-9765-88a550b1678b on hv-cinder-85425 Aug 24 03:58:13.552934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-de35a76d-d2a8-4780-99dc-c00927d36a04 req-101e9862-14af-4246-8de9-d17988b33d4f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045140 Aug 24 03:58:13.553863 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 665/1294] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:14.187235 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:14.188099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:14.194610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.195119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.196130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.196885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.197339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.197772 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.232829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:14.233301 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:14.233733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:14.234194 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'fault' on Instance uuid b1edcdfc-1f9f-49fc-9765-88a550b1678b {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:58:14.277233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.285678 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.287284 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:14.288443 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-74fd3933-6826-4e64-81b4-a69cdac116a3 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1371 microversion: 2.20 time: 0.105286 Aug 24 03:58:14.289597 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 630/1295] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:14 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:15.313259 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:15.313987 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:15.320267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.320783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.321218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.321912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.322406 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.322842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.354193 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:15.354682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:15.355116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:15.355566 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'fault' on Instance uuid b1edcdfc-1f9f-49fc-9765-88a550b1678b {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:58:15.554969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.563185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.565174 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:15.565900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-eef32991-ce35-4051-a15e-e6aeda018e23 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1371 microversion: 2.20 time: 0.257625 Aug 24 03:58:15.566487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 666/1296] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:15 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:16.589743 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:16.590391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:16.597096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.598796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.598796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.598796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.599355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.599788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.631337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:16.631819 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:16.632265 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:16.632800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'fault' on Instance uuid b1edcdfc-1f9f-49fc-9765-88a550b1678b {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:58:16.673621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:16.682602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:16.684114 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:16.685324 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7d27b240-a97c-44f8-a2a6-266af796457a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1371 microversion: 2.20 time: 0.100214 Aug 24 03:58:16.685879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 631/1297] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:16 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 03:58:17.708530 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:17.709088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:17.715976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.716461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.716904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.717601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.718061 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.718532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.751240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:17.751717 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:17.752162 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:17.752694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lazy-loading 'fault' on Instance uuid b1edcdfc-1f9f-49fc-9765-88a550b1678b {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:58:17.796702 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.805462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.807009 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd8d967d9ecb410ea47e130ac3c8b4a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc635aa12d14aa0b2880abe4e4f8f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:17.808178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-84164ea2-7dbb-4a45-a811-c1b5e8517c40 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 200 len: 1371 microversion: 2.20 time: 0.103728 Aug 24 03:58:17.808759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 667/1298] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:17 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 03:58:18.831220 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:18.831908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:18.838600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.839022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.839482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.840189 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:18.840642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:18.841080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:18.856763 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] HTTP exception thrown: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Request method failure captured: Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b HTTP/1.1 Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-OIdheRs2NR6Ch26upr7AzS45jfpMPeHxH7Fb6acilsJ-lGdzC47d-Pn9Da2tTgEt1bhTEH2TPjqDJTq9vyTL6zfrYTQOx9vNQDtUnxaJH9qBVUQK8wCSbAYk5C2MJxEZ_HcMbO_d68L9eK86eGtctQJXtCUaZvUfjBGY4YNMze9E Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:58:18.858592 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: bd8d967d9ecb410ea47e130ac3c8b4a6 Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:18.860001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': 'b1edcdfc-1f9f-49fc-9765-88a550b1678b'} Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:18.860792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:18.862350 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:18.863696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Returning 404 to user: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:18.863696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e24b2816-62a7-4727-8eba-7f95f5e5e378 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 404 len: 111 microversion: 2.20 time: 0.032984 Aug 24 03:58:18.863696 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 632/1299] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:18 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:58:18.870072 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-39a5912f-7996-4a65-a23a-17fcb8f97c72 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '.version_select at 0x7f6c136ceca0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:18.940252 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-39a5912f-7996-4a65-a23a-17fcb8f97c72 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753318992" status: 204 len: 0 microversion: 2.20 time: 0.074761 Aug 24 03:58:18.940826 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 668/1300] 10.222.0.65 () {60 vars in 1262 bytes} [Wed Aug 24 03:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753318992 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 03:58:21.058855 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:21.059434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:21.066243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.066733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.067427 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.068190 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.068660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.069091 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.083029 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] HTTP exception thrown: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Request method failure captured: Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b HTTP/1.1 Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-OIdheRs2NR6Ch26upr7AzS45jfpMPeHxH7Fb6acilsJ-lGdzC47d-Pn9Da2tTgEt1bhTEH2TPjqDJTq9vyTL6zfrYTQOx9vNQDtUnxaJH9qBVUQK8wCSbAYk5C2MJxEZ_HcMbO_d68L9eK86eGtctQJXtCUaZvUfjBGY4YNMze9E Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:58:21.084617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: bd8d967d9ecb410ea47e130ac3c8b4a6 Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.086414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': 'b1edcdfc-1f9f-49fc-9765-88a550b1678b'} Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:21.087321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.088636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.094640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Returning 404 to user: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:21.094640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fb10b52b-73fb-498f-ac15-e6efa2e6e9d6 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 404 len: 111 microversion: 2.20 time: 0.032299 Aug 24 03:58:21.094640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 633/1301] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 03:58:21 2022] DELETE /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:58:21.094917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:21.095532 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: b1edcdfc-1f9f-49fc-9765-88a550b1678b] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:21.102342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.103081 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.103522 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.104241 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:21.104694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:21.105122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:21.119496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] HTTP exception thrown: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Request method failure captured: Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b HTTP/1.1 Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-OIdheRs2NR6Ch26upr7AzS45jfpMPeHxH7Fb6acilsJ-lGdzC47d-Pn9Da2tTgEt1bhTEH2TPjqDJTq9vyTL6zfrYTQOx9vNQDtUnxaJH9qBVUQK8wCSbAYk5C2MJxEZ_HcMbO_d68L9eK86eGtctQJXtCUaZvUfjBGY4YNMze9E Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:58:21.121189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: bd8d967d9ecb410ea47e130ac3c8b4a6 Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.126021 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'b1edcdfc-1f9f-49fc-9765-88a550b1678b'} Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:21.126947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. Aug 24 03:58:21.128465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:21.130554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Returning 404 to user: Instance b1edcdfc-1f9f-49fc-9765-88a550b1678b could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:21.130554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-719882cc-4eac-49ae-8b7f-c6589bd1729a tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b" status: 404 len: 111 microversion: 2.20 time: 0.031810 Aug 24 03:58:21.130554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 669/1302] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:21 2022] GET /compute/v2.1/servers/b1edcdfc-1f9f-49fc-9765-88a550b1678b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:58:22.431667 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.432179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:22.438752 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.439233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.439691 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.440386 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.440860 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.442455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.455547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] HTTP exception thrown: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Request method failure captured: Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 HTTP/1.1 Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBZ-OIdheRs2NR6Ch26upr7AzS45jfpMPeHxH7Fb6acilsJ-lGdzC47d-Pn9Da2tTgEt1bhTEH2TPjqDJTq9vyTL6zfrYTQOx9vNQDtUnxaJH9qBVUQK8wCSbAYk5C2MJxEZ_HcMbO_d68L9eK86eGtctQJXtCUaZvUfjBGY4YNMze9E Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 03:58:22.457212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: bd8d967d9ecb410ea47e130ac3c8b4a6 Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.458975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '67941698-f5a1-496f-a571-64116228b0d3'} Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:22.459871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.461550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.463494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Returning 404 to user: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:22.463494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-44e900bf-dc53-4d7d-a18c-9e8b54f52ccb tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 404 len: 111 microversion: 2.20 time: 0.031451 Aug 24 03:58:22.463494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 634/1303] 10.222.0.65 () {60 vars in 1280 bytes} [Wed Aug 24 03:58:22 2022] DELETE /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:58:22.467581 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:22.468208 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] [instance: 67941698-f5a1-496f-a571-64116228b0d3] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:22.474704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.475198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.475824 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.476652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:22.477842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:22.478368 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:22.492929 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] HTTP exception thrown: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Request method failure captured: Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 HTTP/1.1 Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBZ-OIdheRs2NR6Ch26upr7AzS45jfpMPeHxH7Fb6acilsJ-lGdzC47d-Pn9Da2tTgEt1bhTEH2TPjqDJTq9vyTL6zfrYTQOx9vNQDtUnxaJH9qBVUQK8wCSbAYk5C2MJxEZ_HcMbO_d68L9eK86eGtctQJXtCUaZvUfjBGY4YNMze9E Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 03:58:22.494866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffc635aa12d14aa0b2880abe4e4f8f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: ffc635aa12d14aa0b2880abe4e4f8f2f Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1875724869 Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: bd8d967d9ecb410ea47e130ac3c8b4a6 Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1875724869-project Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.496606 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '67941698-f5a1-496f-a571-64116228b0d3'} Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:58:22.497877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. Aug 24 03:58:22.499379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 03:58:22.503484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] Returning 404 to user: Instance 67941698-f5a1-496f-a571-64116228b0d3 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:58:22.503484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-72aafdeb-bcf3-466a-80d3-161b421ae996 tempest-AttachVolumeShelveTestJSON-1875724869 tempest-AttachVolumeShelveTestJSON-1875724869-project] 10.222.0.65 "GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3" status: 404 len: 111 microversion: 2.20 time: 0.033992 Aug 24 03:58:22.503484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 670/1304] 10.222.0.65 () {60 vars in 1277 bytes} [Wed Aug 24 03:58:22 2022] GET /compute/v2.1/servers/67941698-f5a1-496f-a571-64116228b0d3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 03:58:32.113349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1004307116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1056783115", "security_groups": [{"name": "tempest-secgroup-smoke-550765759"}], "block_device_mapping_v2": [{"uuid": "aadf24d3-5b31-4590-959d-ee4feafad822", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8e8b02d-24a6-4dbc-a526-ca5dd9721bf6"}]}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:32.447196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:32.478815 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] validate_networks() for [('e8e8b02d-24a6-4dbc-a526-ca5dd9721bf6', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:58:33.205535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:58:33.205535 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:58:33.206914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:58:33.207946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:58:33.208582 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:58:33.220306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.220788 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.221229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.221967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:33.222483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:33.223130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:33.243162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:33.247483 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Getting quotas for user 71ff73cade8b42c7ae57be1e3ef0e028 and project 33235ed2b4cd48e7ac205143b814c6fb. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:33.313367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:58:33.316377 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aadf24d3-5b31-4590-959d-ee4feafad822',volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:58:33.758932 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b80236e7-7580-443f-b285-1650fbc1c248 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.649405 Aug 24 03:58:33.759578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 635/1305] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:58:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:58:33.770582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-044f8842-12af-41d5-b730-89dec3d0ae77 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:33.771296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-044f8842-12af-41d5-b730-89dec3d0ae77 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:33.775057 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:33.784874 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=52 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:33.845639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-044f8842-12af-41d5-b730-89dec3d0ae77 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:33.869032 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-044f8842-12af-41d5-b730-89dec3d0ae77 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1095 microversion: 2.1 time: 0.101371 Aug 24 03:58:33.870501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 671/1306] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:33 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:34.896829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:34.898137 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:34.900076 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:34.908080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.908410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.909702 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.910990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:34.911665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:34.912100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:34.996254 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:35.005662 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8c3609c1-4d58-44fe-8424-5310c1903d4e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1145 microversion: 2.1 time: 0.113656 Aug 24 03:58:35.011934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 636/1307] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:34 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:36.026879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:36.027490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:36.035176 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.035667 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.036110 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.036810 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:36.037267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:36.037693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:36.117306 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:36.125276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-379a4f69-d164-4aa5-91f1-9a62cca8d6b9 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1137 microversion: 2.1 time: 0.102270 Aug 24 03:58:36.125880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 672/1308] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:36 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1137 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:37.148055 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:37.149495 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:37.157266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:37.157857 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:37.158422 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.159208 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:37.159813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:37.160317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:37.237848 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:37.246809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f55df3d3-4ab4-46d0-a59f-a6875fde54ae tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1137 microversion: 2.1 time: 0.103889 Aug 24 03:58:37.247517 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 637/1309] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:37 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1137 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:37.491673 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:58:37.492264 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 03:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:58:38.267390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:38.267997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:38.275297 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.276016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.276715 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.277462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:38.277937 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:38.278391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:38.363318 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:38.373684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9a79a32e-7388-4df6-9d2e-816bb8f066ed tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1137 microversion: 2.1 time: 0.110013 Aug 24 03:58:38.374538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 673/1310] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:38 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1137 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:39.397050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:39.404590 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:39.433352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:39.434003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:39.438853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:39.438853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:39.438853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:39.438853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:39.576337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:39.586268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a5e886d9-6a2d-4d95-bae6-d781c8d0da3b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1201 microversion: 2.1 time: 0.195055 Aug 24 03:58:39.594434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 638/1311] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:39 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1201 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:40.613280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:40.617323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:40.623038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.623733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.624177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.625059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:40.625986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:40.626460 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:40.706184 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:40.715934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-68a0e9bb-e950-49f1-9363-283438eb6060 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1211 microversion: 2.1 time: 0.106706 Aug 24 03:58:40.720505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 674/1312] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:40 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:41.737987 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:41.739241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:41.747679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.748607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.749152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:41.750095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:41.751094 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:41.751602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.039161 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:42.050269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-182fe9ad-7465-4268-b7ed-d0a0f1148cf4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.316242 Aug 24 03:58:42.051095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 639/1313] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:41 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:42.565075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-8564b267-cc87-48b7-be22-aa8d06d68b95 req-21b6e024-2460-4ce1-956f-96d3f2c816f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144e4f88-4863-475f-89c6-756d756428ed", "tag": "72a83870-ef59-4319-a61a-a193bbb29b4d"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:42.587235 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8564b267-cc87-48b7-be22-aa8d06d68b95 req-21b6e024-2460-4ce1-956f-96d3f2c816f2 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:42.587726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8564b267-cc87-48b7-be22-aa8d06d68b95 req-21b6e024-2460-4ce1-956f-96d3f2c816f2 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:42.588153 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8564b267-cc87-48b7-be22-aa8d06d68b95 req-21b6e024-2460-4ce1-956f-96d3f2c816f2 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:42.617846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-8564b267-cc87-48b7-be22-aa8d06d68b95 req-21b6e024-2460-4ce1-956f-96d3f2c816f2 service nova] Creating event network-changed:72a83870-ef59-4319-a61a-a193bbb29b4d for instance 144e4f88-4863-475f-89c6-756d756428ed on hv-cinder-85425 Aug 24 03:58:42.625205 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-8564b267-cc87-48b7-be22-aa8d06d68b95 req-21b6e024-2460-4ce1-956f-96d3f2c816f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064727 Aug 24 03:58:42.630325 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 675/1314] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:43.071701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:43.073151 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:43.082229 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.087270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.089016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.090033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:43.090787 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:43.091761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:43.232768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:43.259615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=6 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:43.359284 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:43.369416 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a30afdf0-7b86-4670-a296-eb94115d84bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.301524 Aug 24 03:58:43.376596 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 640/1315] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:43 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:44.266777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:44.393787 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:44.394448 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:44.402547 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.403162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.403600 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.404617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:44.405075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:44.405506 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:44.478265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-200babb4-0ee7-424c-88a0-0251f9b55804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Action: 'create', calling method: .version_select at 0x7f6c182a0b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1023374022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0gHZoXMUTmXiXt/LDbIGxeVvH6ThB42t+eZYGg1MT6YUZ1UN2A8M408HJfy3ujEKLReNMyVBJqTUx+S7TKPV+shewwbYE57Rwzey28/r+xawMc5VUcIa7BKQGDvqtM1w=="}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:44.499979 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-200babb4-0ee7-424c-88a0-0251f9b55804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Getting quotas for project 7a6382d0a8d141e9ab64a41ae43b12af. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:58:44.504102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-200babb4-0ee7-424c-88a0-0251f9b55804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Getting quotas for user 6683479f4e1c419e950fa7497f194ac1 and project 7a6382d0a8d141e9ab64a41ae43b12af. Resources: {'key_pairs'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:58:44.568830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:44.576741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6137b6d1-c6b1-462e-a813-0cf925ddeed4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.187777 Aug 24 03:58:44.577302 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 641/1316] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:44 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:44.683183 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-200babb4-0ee7-424c-88a0-0251f9b55804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.417861 Aug 24 03:58:44.683781 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 676/1317] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 03:58:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:58:45.598874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:45.600769 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:45.610572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.611674 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.616945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.616945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:45.616945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:45.616945 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:45.785706 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:45.795307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8d275e92-139c-4a31-9320-58478f5828bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.200700 Aug 24 03:58:45.806705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 642/1318] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:45 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:46.821868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:46.822783 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:46.839535 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:46.842839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:46.842839 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:46.843900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:46.844572 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:46.846942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:47.109280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:47.134034 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1e4c13d5-febf-4dae-b16c-141579da5e28 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.318932 Aug 24 03:58:47.135333 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 677/1319] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:46 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:48.158705 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:48.160723 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:48.171065 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.171898 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.172348 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.173058 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:48.173518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:48.173951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:48.462635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:48.471884 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-11c448a6-a9b4-419a-ad53-6bfb888fba8b tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.318209 Aug 24 03:58:48.473578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 643/1320] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:48 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:49.494920 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:49.495542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:49.502290 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.502782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.503227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.503928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:49.504387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:49.504820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:49.680143 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:49.688341 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-02452c4d-a088-496e-bbe8-cf705a6ef69c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.197827 Aug 24 03:58:49.688998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 678/1321] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:49 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:50.712854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:50.713748 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:50.720573 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.721059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.721498 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.722356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:50.722824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:50.723252 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:50.884025 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:50.891958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fc4f6313-e4df-41cd-acf5-d0ef0bcd429a tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.183875 Aug 24 03:58:50.892605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 644/1322] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:50 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:51.914837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:51.915561 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:51.922104 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.922654 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.923126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:51.923997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:51.924514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:51.925017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:52.067814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:52.076404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-076e54b4-5eea-4104-bebd-2127a1df8728 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.165880 Aug 24 03:58:52.077103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 679/1323] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:51 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:58:53.097169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:53.097809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:53.104946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:53.105612 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:53.106045 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:53.107145 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:53.107811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:53.108451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:53.256096 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:53.264685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-609a62b1-62f0-47f3-a88e-d400b6241648 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.171521 Aug 24 03:58:53.265625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 645/1324] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:53 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:54.286451 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:54.287102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:54.293989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.294499 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.295982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.295982 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.296331 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.296464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.431730 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:54.440698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2f14d724-0fc3-492c-8e60-5518662b13d3 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.158356 Aug 24 03:58:54.441584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 680/1325] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:54 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:54.442385 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-f34d55d4-7c3a-47f4-8245-da8b5548274f req-9309923d-ed3f-4241-b8d5-beacfbd06c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144e4f88-4863-475f-89c6-756d756428ed", "name": "network-vif-plugged", "status": "completed", "tag": "72a83870-ef59-4319-a61a-a193bbb29b4d"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:58:54.454591 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f34d55d4-7c3a-47f4-8245-da8b5548274f req-9309923d-ed3f-4241-b8d5-beacfbd06c8f service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:54.455074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f34d55d4-7c3a-47f4-8245-da8b5548274f req-9309923d-ed3f-4241-b8d5-beacfbd06c8f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:54.455570 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f34d55d4-7c3a-47f4-8245-da8b5548274f req-9309923d-ed3f-4241-b8d5-beacfbd06c8f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:54.467683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-f34d55d4-7c3a-47f4-8245-da8b5548274f req-9309923d-ed3f-4241-b8d5-beacfbd06c8f service nova] Creating event network-vif-plugged:72a83870-ef59-4319-a61a-a193bbb29b4d for instance 144e4f88-4863-475f-89c6-756d756428ed on hv-cinder-85425 Aug 24 03:58:54.472837 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-f34d55d4-7c3a-47f4-8245-da8b5548274f req-9309923d-ed3f-4241-b8d5-beacfbd06c8f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034695 Aug 24 03:58:54.473405 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 646/1326] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:58:55.469258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:55.469857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:55.476225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.477547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.477986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.478709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:55.479169 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:55.479595 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:55.625187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:55.633203 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-21227610-9dad-4141-819c-48abcd8cdf21 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.167814 Aug 24 03:58:55.633790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 681/1327] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:55 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:56.655733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:56.656571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:56.664080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.664733 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.665183 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.665933 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:56.666413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:56.666878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:56.809992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:56.817771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-56db6e9c-6210-457a-a49e-be76b6c6b7fc tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1266 microversion: 2.1 time: 0.166878 Aug 24 03:58:56.818376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 647/1328] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:56 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:57.840596 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:57.841156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:57.843459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=4 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:57.848357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.848843 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.849298 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.850055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:57.850568 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:57.851000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:57.989089 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:57.998006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1bb1e78a-fbff-4aa2-9932-8a3be0563274 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1452 microversion: 2.1 time: 0.162188 Aug 24 03:58:57.998608 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 682/1329] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:57 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:58:58.018282 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:58:58.018896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:58:58.025329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.025808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:58.026277 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:58.027032 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:58:58.027525 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:58:58.027954 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:58:58.220879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:58:58.228333 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-575024a9-d0fd-47d5-910a-3978dc9f7070 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1452 microversion: 2.1 time: 0.214024 Aug 24 03:58:58.229028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 648/1330] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:58:58 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1452 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:01.073422 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-8dc72fcb-999b-4ae4-8cf1-57b2b617de9e req-7cbe91ba-f36d-4b29-b41a-2b4adc86f975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144e4f88-4863-475f-89c6-756d756428ed", "tag": "72a83870-ef59-4319-a61a-a193bbb29b4d"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:01.083484 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8dc72fcb-999b-4ae4-8cf1-57b2b617de9e req-7cbe91ba-f36d-4b29-b41a-2b4adc86f975 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:01.083967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8dc72fcb-999b-4ae4-8cf1-57b2b617de9e req-7cbe91ba-f36d-4b29-b41a-2b4adc86f975 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:01.084403 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-8dc72fcb-999b-4ae4-8cf1-57b2b617de9e req-7cbe91ba-f36d-4b29-b41a-2b4adc86f975 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:01.100616 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-8dc72fcb-999b-4ae4-8cf1-57b2b617de9e req-7cbe91ba-f36d-4b29-b41a-2b4adc86f975 service nova] Creating event network-changed:72a83870-ef59-4319-a61a-a193bbb29b4d for instance 144e4f88-4863-475f-89c6-756d756428ed on hv-cinder-85425 Aug 24 03:59:01.111445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-8dc72fcb-999b-4ae4-8cf1-57b2b617de9e req-7cbe91ba-f36d-4b29-b41a-2b4adc86f975 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041767 Aug 24 03:59:01.112367 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 683/1331] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:17.029602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1061663807", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1023374022", "security_groups": [{"name": "tempest-secgroup-smoke-2019637821"}], "networks": [{"uuid": "8fa094ec-bd56-425f-adc4-de119f84b07b"}], "block_device_mapping_v2": [{"uuid": "c013f130-5867-4979-9512-5afc413ae7e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:17.041209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=25 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:17.041876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=76 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:17.158584 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.network.neutron [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] validate_networks() for [('8fa094ec-bd56-425f-adc4-de119f84b07b', None, None, None, None, None)] {{(pid=127736) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:59:17.656001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Flavor limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:59:17.656504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Image limits 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:59:17.657073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Flavor pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:59:17.657551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Image pref 0:0:0 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:59:17.658109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.virt.hardware [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127736) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:59:17.668130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.668688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.669196 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.669981 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:17.670465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:17.670887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:17.690305 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Getting quotas for project 7a6382d0a8d141e9ab64a41ae43b12af. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:59:17.694206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Getting quotas for user 6683479f4e1c419e950fa7497f194ac1 and project 7a6382d0a8d141e9ab64a41ae43b12af. Resources: {'ram', 'cores', 'instances'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:59:17.754737 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Going to run 1 instances... {{(pid=127736) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:59:17.756844 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c013f130-5867-4979-9512-5afc413ae7e1',volume_size=None,volume_type=None)] {{(pid=127736) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:59:18.175233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e7248f80-c51e-49c0-9f27-293bd04c5f39 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.149517 Aug 24 03:59:18.178566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 649/1332] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 03:59:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:59:18.185125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:18.188362 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=58 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:18.190903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-07981321-9521-4a38-b4d9-60d5525643cd tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:18.191811 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-07981321-9521-4a38-b4d9-60d5525643cd tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:18.247652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-07981321-9521-4a38-b4d9-60d5525643cd tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:18.255302 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-07981321-9521-4a38-b4d9-60d5525643cd tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1089 microversion: 2.1 time: 0.071997 Aug 24 03:59:18.255878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 684/1333] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:18 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:19.279735 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-91d43451-a627-4fee-bbdf-0bc97cb34a04 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:19.280354 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-91d43451-a627-4fee-bbdf-0bc97cb34a04 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:19.337625 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-91d43451-a627-4fee-bbdf-0bc97cb34a04 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:19.345266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-91d43451-a627-4fee-bbdf-0bc97cb34a04 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1089 microversion: 2.1 time: 0.070795 Aug 24 03:59:19.357640 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 650/1334] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:19 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:20.367799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:20.369023 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:20.377463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.377948 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.378417 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.379116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:20.379577 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:20.380007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:20.445262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:20.453025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-837f35a0-ecc9-49ec-9293-6356f59899a7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1187 microversion: 2.1 time: 0.089902 Aug 24 03:59:20.453589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 685/1335] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:20 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:21.474146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:21.474771 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:21.481586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.482072 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.482578 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.483272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:21.483727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:21.484181 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:21.573621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:21.581687 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a4ba36d8-fc5b-4c96-9798-2484b8ccb3aa tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1205 microversion: 2.1 time: 0.111681 Aug 24 03:59:21.589332 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 651/1336] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:21 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1205 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:22.607678 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:22.608427 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:22.614554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.615037 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.615475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.616271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:22.616724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:22.617151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:22.752756 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:22.760434 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dfff04dd-491b-4746-bff6-6c152dd13c48 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1273 microversion: 2.1 time: 0.157270 Aug 24 03:59:22.761165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 686/1337] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:22 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:23.781781 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:23.782347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:23.788757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.789244 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.789685 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.790420 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:23.790876 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:23.792162 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:23.932089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:23.939778 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8e251cd3-ea1e-4510-9b81-5746115caf7a tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1273 microversion: 2.1 time: 0.161985 Aug 24 03:59:23.940339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 652/1338] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:23 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:24.962879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:24.963776 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:24.971391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:24.972159 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:24.972802 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:24.973707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:24.975030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:24.979433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:25.235553 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:25.244400 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-125fbe4b-5b08-4cbb-b941-8e8d0e12a357 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1273 microversion: 2.1 time: 0.285293 Aug 24 03:59:25.245095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 687/1339] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:24 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:26.208001 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-14d02c2b-a097-4d28-ac62-6252fd0f580a req-2572cca9-f72f-4ff7-88a0-0323d01d705e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:26.219248 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-14d02c2b-a097-4d28-ac62-6252fd0f580a req-2572cca9-f72f-4ff7-88a0-0323d01d705e service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.220689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-14d02c2b-a097-4d28-ac62-6252fd0f580a req-2572cca9-f72f-4ff7-88a0-0323d01d705e service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.220689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-14d02c2b-a097-4d28-ac62-6252fd0f580a req-2572cca9-f72f-4ff7-88a0-0323d01d705e service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.235276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-14d02c2b-a097-4d28-ac62-6252fd0f580a req-2572cca9-f72f-4ff7-88a0-0323d01d705e service nova] Creating event network-changed:99852f4e-152c-485a-a027-71d139b1ee8b for instance 45290dc1-ea22-4c71-8eec-503758124b99 on hv-cinder-85425 Aug 24 03:59:26.243594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-14d02c2b-a097-4d28-ac62-6252fd0f580a req-2572cca9-f72f-4ff7-88a0-0323d01d705e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203393 Aug 24 03:59:26.243594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 653/1340] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:59:26.265404 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:26.266695 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:26.272630 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.273119 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.273591 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.274286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:26.274750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:26.275209 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:26.493255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:26.501142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-17ee1574-9f12-4eb6-b7b5-33911e8273df tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1273 microversion: 2.1 time: 0.239385 Aug 24 03:59:26.501644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 688/1341] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:26 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:27.523342 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:27.524067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:27.530409 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.530895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.531334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.532028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:27.532479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:27.532907 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:27.680084 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:27.733464 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:27.741240 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d9b05458-2e0b-41fa-b725-7ab5d33c6cbf tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.222788 Aug 24 03:59:27.741799 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 654/1342] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:27 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:28.763663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:28.764238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:28.766575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:28.771323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:28.771813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:28.780374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:28.780374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:28.780374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:28.780374 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:28.909071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:28.917513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f22614d9-7334-4446-a9d9-43bbbdb0f6b2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.157937 Aug 24 03:59:28.918085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 689/1343] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:28 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:29.937307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:29.937915 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:29.940328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=8 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:29.945158 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:29.953651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:29.953651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:29.953651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:29.953651 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:29.954039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:30.078627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:30.086362 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4742e315-e938-46e9-a298-ad21433a89f7 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.153387 Aug 24 03:59:30.086922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 655/1344] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:29 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:31.107871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:31.108482 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:31.114963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:31.115378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:31.115813 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:31.116493 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:31.116934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:31.117358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:31.254914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:31.262871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0f0f8f85-bbbf-4de4-bb07-28836bc93ed6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.159711 Aug 24 03:59:31.263440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 690/1345] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:31 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:32.284132 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:32.284858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:32.291768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.292328 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.292767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.293478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:32.293911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:32.294391 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:32.500998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:32.509165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1e409b6c-2234-4704-a97f-1dbc43c598b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.229741 Aug 24 03:59:32.509800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 656/1346] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:32 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:33.531860 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:33.532560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:33.539978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:33.540442 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:33.541068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:33.542125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:33.542629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:33.543057 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:33.729716 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:33.738178 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-72028605-888e-4efd-b7f5-1f65f8281a2b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.211883 Aug 24 03:59:33.738764 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 691/1347] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:33 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:34.760069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:34.766661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:34.767155 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:34.767712 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:34.768060 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:34.768755 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:34.769215 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:34.769643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:34.919504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:34.930128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-14591c60-1670-4914-a488-1f465c019286 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.171677 Aug 24 03:59:34.930128 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 657/1348] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:34 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:35.949600 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:35.950223 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:35.956900 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:35.957379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:35.957840 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:35.958646 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:35.959145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:35.959601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:36.096051 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:36.105694 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-19c9a680-1d33-450d-9f49-46031c270e37 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.160213 Aug 24 03:59:36.108105 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 692/1349] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:35 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:37.127949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:37.130322 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:37.138099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:37.139003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:37.139458 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:37.140173 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:37.140811 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:37.141268 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:37.210749 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-3cd8f51c-9167-4c03-b491-04b22c4ebcf8 req-e11fbff4-7c15-4bec-9e58-c237baf2b24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "name": "network-vif-plugged", "status": "completed", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:37.222623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-3cd8f51c-9167-4c03-b491-04b22c4ebcf8 req-e11fbff4-7c15-4bec-9e58-c237baf2b24c service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:37.223391 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-3cd8f51c-9167-4c03-b491-04b22c4ebcf8 req-e11fbff4-7c15-4bec-9e58-c237baf2b24c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:37.224055 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-3cd8f51c-9167-4c03-b491-04b22c4ebcf8 req-e11fbff4-7c15-4bec-9e58-c237baf2b24c service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:37.237007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-3cd8f51c-9167-4c03-b491-04b22c4ebcf8 req-e11fbff4-7c15-4bec-9e58-c237baf2b24c service nova] Creating event network-vif-plugged:99852f4e-152c-485a-a027-71d139b1ee8b for instance 45290dc1-ea22-4c71-8eec-503758124b99 on hv-cinder-85425 Aug 24 03:59:37.242102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-3cd8f51c-9167-4c03-b491-04b22c4ebcf8 req-e11fbff4-7c15-4bec-9e58-c237baf2b24c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035119 Aug 24 03:59:37.243126 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 693/1350] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:59:37.286023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:37.294294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6aabb6b5-aeeb-4d64-b4ab-a4fbe92d0efe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.170374 Aug 24 03:59:37.294882 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 658/1351] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:37 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:38.316412 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:38.317118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:38.326358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.326358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.326358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.326358 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:38.326771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:38.326771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:38.469475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:38.477463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a0972ec8-6bf6-44df-aecd-c53e16fd1f01 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.165951 Aug 24 03:59:38.478082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 694/1352] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:38 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:39.499980 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:39.500589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:39.507109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:39.507586 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:39.508021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:39.508715 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:39.509167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:39.509598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:39.665693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:39.674050 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bf0f358a-9394-499a-bc77-b7bc9013d2a5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1261 microversion: 2.1 time: 0.178640 Aug 24 03:59:39.674669 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 659/1353] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:39 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:40.694955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:40.695732 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:40.702984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.703475 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.703916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.704626 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.705083 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.705510 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.842282 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:40.850474 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-dfcd05e9-86f6-461b-8178-4c86ead2e696 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1445 microversion: 2.1 time: 0.159405 Aug 24 03:59:40.851031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 695/1354] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:40 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:40.871484 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:59:40.872919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:59:40.881283 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.885783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.885783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:40.885783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:40.885783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:40.886343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:41.024652 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:59:41.035222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-a9079a87-0c8d-49a1-893a-2d687b59f4ac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1445 microversion: 2.1 time: 0.165880 Aug 24 03:59:41.035222 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 660/1355] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 03:59:40 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1445 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:59:43.265022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-39312408-a7ba-400b-bd43-525e84807e57 req-99e934df-c494-48c8-95f4-f8268a0e004e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:59:43.274854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-39312408-a7ba-400b-bd43-525e84807e57 req-99e934df-c494-48c8-95f4-f8268a0e004e service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:59:43.275328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-39312408-a7ba-400b-bd43-525e84807e57 req-99e934df-c494-48c8-95f4-f8268a0e004e service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:59:43.277421 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-39312408-a7ba-400b-bd43-525e84807e57 req-99e934df-c494-48c8-95f4-f8268a0e004e service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:59:43.287658 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-39312408-a7ba-400b-bd43-525e84807e57 req-99e934df-c494-48c8-95f4-f8268a0e004e service nova] Creating event network-changed:99852f4e-152c-485a-a027-71d139b1ee8b for instance 45290dc1-ea22-4c71-8eec-503758124b99 on hv-cinder-85425 Aug 24 03:59:43.293229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-39312408-a7ba-400b-bd43-525e84807e57 req-99e934df-c494-48c8-95f4-f8268a0e004e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 Aug 24 03:59:43.293825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 696/1356] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 03:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:47.281679 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.288013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=58 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.288013 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ac8e60b9-f31f-4ebb-81c0-2e0c813c466f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Action: 'create', calling method: .version_select at 0x7f6c184123a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1779408328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl6bbhRssLF+Dz6bhZZq5UdtzdtfvOu5D6Q2snJrwk/6nmARDs5HzIQROv+LoxinMhmc0XG3c6hzK2s6I4ZaXJRoB6YQgRRV/VTGdY+ipfWB+291VOxlpaU6a/L+09JOA=="}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:47.304059 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-ac8e60b9-f31f-4ebb-81c0-2e0c813c466f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Getting quotas for project e2c1183122314dbd8982c3d24a9b041e. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:47.308429 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.quota [None req-ac8e60b9-f31f-4ebb-81c0-2e0c813c466f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Getting quotas for user 541f59acaa84467783f63c278a7f0485 and project e2c1183122314dbd8982c3d24a9b041e. Resources: {'key_pairs'} {{(pid=127736) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:47.402327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ac8e60b9-f31f-4ebb-81c0-2e0c813c466f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.122390 Aug 24 04:00:47.403182 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 661/1357] 10.222.0.65 () {60 vars in 1159 bytes} [Wed Aug 24 04:00:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:00:47.456643 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=28 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.457425 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=64 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.463726 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-360447002", "imageRef": "f45896cd-8208-4ee2-899e-729b098e038f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1779408328", "networks": [{"uuid": "81761e1e-ed66-46e9-ad9e-03b9c3157801"}]}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:00:47.529042 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.network.neutron [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] validate_networks() for [('81761e1e-ed66-46e9-ad9e-03b9c3157801', None, None, None, None, None)] {{(pid=127737) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:00:48.016328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Flavor limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:00:48.016750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Image limits 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:00:48.017223 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Flavor pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:00:48.017634 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Image pref 0:0:0 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:00:48.018045 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.virt.hardware [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127737) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:00:48.026890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:48.027366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:48.027801 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:48.028529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:48.028980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:48.029407 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:48.045905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Getting quotas for project e2c1183122314dbd8982c3d24a9b041e. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:00:48.049945 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.quota [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Getting quotas for user 541f59acaa84467783f63c278a7f0485 and project e2c1183122314dbd8982c3d24a9b041e. Resources: {'ram', 'cores', 'instances'} {{(pid=127737) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:00:48.061666 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Going to run 1 instances... {{(pid=127737) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:00:48.063998 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f45896cd-8208-4ee2-899e-729b098e038f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127737) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:00:48.214285 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1e1b0b63-bf57-4852-ae1b-4a4a395df5d6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760835 Aug 24 04:00:48.214934 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 697/1358] 10.222.0.65 () {60 vars in 1147 bytes} [Wed Aug 24 04:00:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:00:48.227211 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-427fea0d-9bd2-4e74-a5d0-3999f9823128 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:48.227838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-427fea0d-9bd2-4e74-a5d0-3999f9823128 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:48.283589 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-427fea0d-9bd2-4e74-a5d0-3999f9823128 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:48.292383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-427fea0d-9bd2-4e74-a5d0-3999f9823128 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1258 microversion: 2.1 time: 0.070352 Aug 24 04:00:48.292955 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 662/1359] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:48 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:00:49.313979 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:49.316615 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:49.322198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:49.322683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:49.323166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:49.323955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:49.324401 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:49.324825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:49.390689 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:49.399125 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f2b59f09-4a82-4cd9-a7a1-e6de688d41d3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1262 microversion: 2.1 time: 0.088996 Aug 24 04:00:49.400230 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 698/1360] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:49 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:50.420226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:50.420866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:50.428530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:50.429026 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:50.429466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:50.430179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:50.430637 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:50.431070 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:50.492101 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:50.500057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e0f8933b-bfd2-4741-80b9-9d50f915e51a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1310 microversion: 2.1 time: 0.083723 Aug 24 04:00:50.500932 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 663/1361] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:50 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:51.529323 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:51.532096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:51.545048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:51.546890 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:51.547640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:51.548773 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:51.549613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:51.550414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:51.729825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:51.738556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-46702985-f909-45b4-b72c-64d738f90d59 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.218279 Aug 24 04:00:51.745518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 699/1362] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:51 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:52.760166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:52.760731 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:52.768331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.769233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.769757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.770574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:52.771030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:52.771461 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:52.918571 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:52.928100 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ea3096ba-ecb6-41e2-b74e-4235723a4dfc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.172636 Aug 24 04:00:52.928670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 664/1363] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:52 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:53.949707 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:53.950359 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:53.956975 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:53.957462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:53.957901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:53.958629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:53.959083 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:53.959509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:54.098586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:54.107922 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-15e6d84b-2647-42e0-abe0-87036fcb9f6b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.162594 Aug 24 04:00:54.108556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 700/1364] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:53 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:55.128531 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:55.129133 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:55.136275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:55.136762 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:55.137200 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.137894 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:55.138383 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:55.138813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:55.281007 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:55.288710 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c1275cd1-d249-46f6-84e9-37fa067c38aa tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.164191 Aug 24 04:00:55.294850 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 665/1365] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:55 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:56.310146 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:56.311080 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:56.317978 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.319830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.319830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.320169 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:56.320518 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:56.321328 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:56.466415 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:56.474903 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c85c033b-0d38-4b0f-a895-ab2ec2d091fc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.168660 Aug 24 04:00:56.475954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 701/1366] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:56 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:57.497174 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:57.497827 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:57.504610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:57.505109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:57.505621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.506382 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:57.506835 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:57.507269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:57.648376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:57.657228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-cb9ac09b-709d-4df4-9beb-bd6828bb6ee6 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.164693 Aug 24 04:00:57.669511 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 666/1367] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:57 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:58.683353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:58.684054 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:58.686355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=2 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.692322 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell0:SELECT=6 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.697914 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.698443 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.698887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.699599 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:58.700057 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:58.700487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:58.847229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:00:58.856156 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6f3ad0c7-8ebb-42c0-a6c0-8fa978368507 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.179863 Aug 24 04:00:58.857089 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 702/1368] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:58 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:59.877713 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:00:59.878356 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:00:59.880210 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=6 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.886300 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:59.886783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:59.887223 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:00:59.887919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:00:59.888374 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:00:59.888801 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:00.016563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:00.024276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b295c841-dbe6-4398-8a89-df90af874364 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.150411 Aug 24 04:01:00.024892 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 667/1369] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:00:59 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:01.045175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:01.045795 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:01.052487 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:01.052974 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:01.053430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:01.054142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:01.054663 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:01.055096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:01.260905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:01.269078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-9bd7b68a-7e4e-4ba6-a153-e14c6995a13b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.227774 Aug 24 04:01:01.269682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 703/1370] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:01 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:01.920207 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-edb5c87b-2f61-4c4b-89a7-e8222887f52f req-70d1a95e-1dce-4a95-88ef-b794897616f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:01.929909 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-edb5c87b-2f61-4c4b-89a7-e8222887f52f req-70d1a95e-1dce-4a95-88ef-b794897616f1 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:01.930421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-edb5c87b-2f61-4c4b-89a7-e8222887f52f req-70d1a95e-1dce-4a95-88ef-b794897616f1 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:01.931469 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-edb5c87b-2f61-4c4b-89a7-e8222887f52f req-70d1a95e-1dce-4a95-88ef-b794897616f1 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:01.942838 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-edb5c87b-2f61-4c4b-89a7-e8222887f52f req-70d1a95e-1dce-4a95-88ef-b794897616f1 service nova] Creating event network-changed:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:01:01.948259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-edb5c87b-2f61-4c4b-89a7-e8222887f52f req-70d1a95e-1dce-4a95-88ef-b794897616f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Aug 24 04:01:01.949143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 668/1371] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:02.294569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:02.295349 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:02.304405 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:02.305620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:02.305620 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:02.306428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:02.307001 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:02.307440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:02.516609 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:02.526464 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-15d98b79-2c2a-4ab9-90c3-cdee059e2620 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.239821 Aug 24 04:01:02.527085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 704/1372] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:02 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:03.549655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:03.550303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:03.557095 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:03.557574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:03.558010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:03.558726 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:03.559179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:03.559605 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:03.697944 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:03.705568 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-91bf846d-9265-4839-b79b-6d4820a00ab3 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.160715 Aug 24 04:01:03.706127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 669/1373] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:03 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:04.727428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:04.728708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:04.736258 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:04.736742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:04.737187 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:04.737877 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:04.738356 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:04.738782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:04.866584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:04.874942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-98df40c3-d59c-4a4d-8467-924af4c9c621 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.151764 Aug 24 04:01:04.875500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 705/1374] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:04 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:05.895797 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:05.896399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:05.902878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.903357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.903817 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:05.904497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:05.904939 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:05.905358 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:06.035526 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:06.043250 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-da9f115b-7507-4afe-9a2b-76f4338056bd tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.151454 Aug 24 04:01:06.043813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 670/1375] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:05 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:07.064681 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:07.065290 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:07.071857 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.077354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.077354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:07.077354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:07.077354 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:07.077837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:07.203850 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:07.211480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2a21bba2-2ce5-4e99-a6e7-f78484d31f11 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.150625 Aug 24 04:01:07.212042 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 706/1376] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:07 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:08.233919 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:08.234567 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:08.241401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:08.241929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:08.242465 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:08.243206 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:08.243653 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:08.244079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:08.376078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:08.383734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-92556773-ca65-483f-9ab2-6a496f3010c1 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.154825 Aug 24 04:01:08.384297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 671/1377] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:08 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:09.404847 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:09.405505 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:09.412352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.413098 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.413213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.413935 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.414419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.414853 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.546326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:09.554040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-566d1989-4a2e-46b2-8965-86716bb3a0e0 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.153257 Aug 24 04:01:09.554524 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 707/1378] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:09 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:09.760902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-4547bbd2-5468-4c8e-be68-d4006a19ab56 req-1826e2ff-99c1-4310-9c6e-e6f6725c69c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "name": "network-vif-plugged", "status": "completed", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:09.770500 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-4547bbd2-5468-4c8e-be68-d4006a19ab56 req-1826e2ff-99c1-4310-9c6e-e6f6725c69c4 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:09.770971 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-4547bbd2-5468-4c8e-be68-d4006a19ab56 req-1826e2ff-99c1-4310-9c6e-e6f6725c69c4 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:09.771398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-4547bbd2-5468-4c8e-be68-d4006a19ab56 req-1826e2ff-99c1-4310-9c6e-e6f6725c69c4 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:09.784555 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-4547bbd2-5468-4c8e-be68-d4006a19ab56 req-1826e2ff-99c1-4310-9c6e-e6f6725c69c4 service nova] Creating event network-vif-plugged:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:01:09.789457 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-4547bbd2-5468-4c8e-be68-d4006a19ab56 req-1826e2ff-99c1-4310-9c6e-e6f6725c69c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154590 Aug 24 04:01:09.790120 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 672/1379] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:10.576542 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:10.577165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:10.583538 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:10.584017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:10.584453 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:10.585147 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:10.585597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:10.586024 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:10.720680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:10.728602 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6c201e4f-f6f0-4505-9d70-53d4a3638ffc tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1358 microversion: 2.1 time: 0.156669 Aug 24 04:01:10.730116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 708/1380] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:10 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:11.751660 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:11.752270 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:11.758932 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.759446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.759885 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.761099 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.761551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.761983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.890980 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:11.898551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fcaca3f2-1ae9-418b-9620-b015b02a5a46 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1548 microversion: 2.1 time: 0.151264 Aug 24 04:01:11.899121 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 673/1381] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:11 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:11.918597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:11.919214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:11.925483 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.925981 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.926445 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:11.927135 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:11.927589 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:11.928017 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.058975 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.066869 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d799ca24-4b70-4169-a10d-fd21f5802326 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1548 microversion: 2.1 time: 0.152199 Aug 24 04:01:12.067544 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 709/1382] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:11 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:12.087260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:12.092179 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.096369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Searching by: {'deleted': False, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e'} {{(pid=127736) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 04:01:12.099610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.100146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.100780 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.101497 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.101949 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.102413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.190146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.multi_cell_list [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127736) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 04:01:12.286392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7ce2d5d5-933f-4235-ae0f-0b2bd6f3b5c4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202724 Aug 24 04:01:12.286896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 674/1383] 10.222.0.65 () {58 vars in 1125 bytes} [Wed Aug 24 04:01:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:12.304955 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:12.305575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:12.312603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.313092 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.313534 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.314274 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:12.314735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:12.315165 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:12.446508 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:12.454164 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-4e2ba41c-2d71-4298-8be1-5c9d7e12f775 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1548 microversion: 2.1 time: 0.153063 Aug 24 04:01:12.454725 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 710/1384] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:12 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:14.432048 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16921b25-2c10-4a88-9183-1650d7bb35ad"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:14.434363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:14.440816 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:14.441323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:14.441768 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:14.442482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:14.442958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:14.443408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:15.226896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0b76c7f1-a62c-4bc4-870a-2721406f96a8 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798697 Aug 24 04:01:15.227518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 675/1385] 10.222.0.65 () {60 vars in 1323 bytes} [Wed Aug 24 04:01:14 2022] POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:16.405868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:16.406448 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:16.410629 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-fe3ff8de-4771-421b-8670-68090f80da13 req-ed8cc8a7-707d-4c87-a596-8ee334994958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144e4f88-4863-475f-89c6-756d756428ed", "tag": "72a83870-ef59-4319-a61a-a193bbb29b4d"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:16.412594 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.413088 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.413528 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.414497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.415166 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.415846 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.423016 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-fe3ff8de-4771-421b-8670-68090f80da13 req-ed8cc8a7-707d-4c87-a596-8ee334994958 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.423492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-fe3ff8de-4771-421b-8670-68090f80da13 req-ed8cc8a7-707d-4c87-a596-8ee334994958 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.423922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-fe3ff8de-4771-421b-8670-68090f80da13 req-ed8cc8a7-707d-4c87-a596-8ee334994958 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.435033 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-fe3ff8de-4771-421b-8670-68090f80da13 req-ed8cc8a7-707d-4c87-a596-8ee334994958 service nova] Creating event network-changed:72a83870-ef59-4319-a61a-a193bbb29b4d for instance 144e4f88-4863-475f-89c6-756d756428ed on hv-cinder-85425 Aug 24 04:01:16.440169 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-fe3ff8de-4771-421b-8670-68090f80da13 req-ed8cc8a7-707d-4c87-a596-8ee334994958 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Aug 24 04:01:16.440849 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 676/1386] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:01:16.445868 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Going to try to terminate instance {{(pid=127737) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:01:16.750521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-979500ae-cc24-411c-836d-ffd81b0b91bb tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 204 len: 0 microversion: 2.1 time: 0.348219 Aug 24 04:01:16.756160 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 711/1387] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 04:01:16 2022] DELETE /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:16.760588 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:16.761370 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:16.767518 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.768003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.768446 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.769143 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:16.769606 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:16.770030 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:16.907170 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:16.915621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-e3ab2053-98e0-4ef4-b607-6d64ee9ba211 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.159957 Aug 24 04:01:16.922191 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 677/1388] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:16 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:17.937414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:17.938118 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:17.940500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:17.945240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:17.945727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:17.946191 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:17.946895 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:17.947498 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:17.947954 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:17.951881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:18.085091 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:18.094031 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-671dc71c-7dbb-4af0-9be4-7e265d7d9a34 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.161100 Aug 24 04:01:18.100068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 712/1389] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:17 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:19.116260 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:19.116878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:19.119853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:19.124564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:19.125044 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:19.125482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:19.126193 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:19.126649 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:19.127075 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:19.130952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:19.261953 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:19.269645 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-c34ba7f5-28d4-41a4-a9d8-e64a36a013d4 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.157274 Aug 24 04:01:19.270226 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 678/1390] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:19 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:20.291459 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:20.292112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:20.299090 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:20.299612 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:20.300056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:20.300753 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:20.301210 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:20.301640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:20.434239 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:20.441917 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0471a150-8558-4a17-a1d4-fac81c9cd425 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.155077 Aug 24 04:01:20.442517 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 713/1391] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:20 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:21.463149 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:21.463757 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:21.470929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.471407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.471832 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:21.472514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:21.472959 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:21.473376 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:21.612670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:21.620929 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f87f546a-99a7-4c41-a152-60c1bdd83876 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.161268 Aug 24 04:01:21.621505 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 679/1392] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:21 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:22.641989 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:22.642601 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:22.654533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:22.654533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:22.654533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:22.654533 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:22.654924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:22.654924 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:22.786629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:22.794598 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7ffe01d9-0c04-4193-b1da-d627a49339d2 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.156528 Aug 24 04:01:22.795168 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 714/1393] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:22 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:23.564616 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-b68ac77c-3f1c-4be3-8998-b4395b91162f req-8f75385e-6c42-4f32-a48b-3d7b6263231a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144e4f88-4863-475f-89c6-756d756428ed", "name": "network-vif-unplugged", "status": "completed", "tag": "72a83870-ef59-4319-a61a-a193bbb29b4d"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:23.569635 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell0:SELECT=2 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.575708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b68ac77c-3f1c-4be3-8998-b4395b91162f req-8f75385e-6c42-4f32-a48b-3d7b6263231a service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:23.576176 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b68ac77c-3f1c-4be3-8998-b4395b91162f req-8f75385e-6c42-4f32-a48b-3d7b6263231a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:23.576598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-b68ac77c-3f1c-4be3-8998-b4395b91162f req-8f75385e-6c42-4f32-a48b-3d7b6263231a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:23.587127 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-b68ac77c-3f1c-4be3-8998-b4395b91162f req-8f75385e-6c42-4f32-a48b-3d7b6263231a service nova] Creating event network-vif-unplugged:72a83870-ef59-4319-a61a-a193bbb29b4d for instance 144e4f88-4863-475f-89c6-756d756428ed on hv-cinder-85425 Aug 24 04:01:23.592340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-b68ac77c-3f1c-4be3-8998-b4395b91162f req-8f75385e-6c42-4f32-a48b-3d7b6263231a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031388 Aug 24 04:01:23.592908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 680/1394] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:23.816036 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:23.816650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:23.823006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:23.823521 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:23.824027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:23.824659 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:23.825116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:23.825545 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:23.957059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:23.966128 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b4aea1ab-dead-4ae4-a4d4-c3a0840f354d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1577 microversion: 2.1 time: 0.153409 Aug 24 04:01:23.968102 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 715/1395] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:23 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:24.989902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:24.990647 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:24.997655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:25.001276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:25.001276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:25.001276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:25.001276 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:25.001785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:25.177085 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:25.185843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-91888bff-d7f3-456b-9555-eca99894fb08 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1458 microversion: 2.1 time: 0.201008 Aug 24 04:01:25.190434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 681/1396] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:24 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1458 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:26.070465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-cf481fc4-07b8-4c77-9ec7-61214bee974a req-135abdf7-7870-4a63-be97-d96c2ec338e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144e4f88-4863-475f-89c6-756d756428ed", "name": "network-vif-deleted", "tag": "72a83870-ef59-4319-a61a-a193bbb29b4d"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:26.081177 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-cf481fc4-07b8-4c77-9ec7-61214bee974a req-135abdf7-7870-4a63-be97-d96c2ec338e6 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:26.081683 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-cf481fc4-07b8-4c77-9ec7-61214bee974a req-135abdf7-7870-4a63-be97-d96c2ec338e6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:26.082122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-cf481fc4-07b8-4c77-9ec7-61214bee974a req-135abdf7-7870-4a63-be97-d96c2ec338e6 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:26.092878 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-cf481fc4-07b8-4c77-9ec7-61214bee974a req-135abdf7-7870-4a63-be97-d96c2ec338e6 service nova] Creating event network-vif-deleted:72a83870-ef59-4319-a61a-a193bbb29b4d for instance 144e4f88-4863-475f-89c6-756d756428ed on hv-cinder-85425 Aug 24 04:01:26.098619 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-cf481fc4-07b8-4c77-9ec7-61214bee974a req-135abdf7-7870-4a63-be97-d96c2ec338e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 Aug 24 04:01:26.100844 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 716/1397] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:26.207395 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:26.207999 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:26.214723 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:26.215251 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:26.215642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:26.216323 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:26.216886 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:26.217188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:26.288581 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:26.297187 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6bb6930d-526f-4e95-983d-fe09e021838f tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1391 microversion: 2.1 time: 0.093741 Aug 24 04:01:26.297758 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 682/1398] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:26 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:27.064247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:27.064948 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:27.071056 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.077314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.077314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.077314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.077314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.077738 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.203976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:27.212265 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-56ec913a-0d68-4260-9d61-2f5c4f8a49e4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1594 microversion: 2.1 time: 0.152346 Aug 24 04:01:27.214885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 717/1399] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:27 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:27.318734 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:27.319343 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:27.326297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.326790 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.327219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.327946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.328410 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.328829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.360872 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:27.361347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:27.361779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:27.362249 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lazy-loading 'fault' on Instance uuid 144e4f88-4863-475f-89c6-756d756428ed {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:01:27.403655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:27.411476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-72606140-6581-4e23-b8e5-b431b4765d04 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 200 len: 1231 microversion: 2.1 time: 0.096635 Aug 24 04:01:27.412293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 683/1400] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:27 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:28.437216 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:28.437814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 144e4f88-4863-475f-89c6-756d756428ed] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:28.444245 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:28.444735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:28.445179 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:28.445879 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:28.446360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:28.446794 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:28.461706 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] HTTP exception thrown: Instance 144e4f88-4863-475f-89c6-756d756428ed could not be found. Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Request method failure captured: Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed HTTP/1.1 Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaBQuTuIGAAB3fObggHoQW_Xno49tkv2gwkvr0o237akeNYQHpnrgN1SD64IeNJWpvBpatHnMSKfX5JIGeyjqDQBbDDkuvU2IeOJm796nbvbE5hGxD9KhpHnHMswLYUfKrchNrdnh675PqnVYcUH6U93yWs1yv8D8rOYhRJkM8GNFHE Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 04:01:28.463557 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 71ff73cade8b42c7ae57be1e3ef0e028 Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 144e4f88-4863-475f-89c6-756d756428ed could not be found. Aug 24 04:01:28.465380 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '144e4f88-4863-475f-89c6-756d756428ed'} Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144e4f88-4863-475f-89c6-756d756428ed could not be found. Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:01:28.472652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144e4f88-4863-475f-89c6-756d756428ed could not be found. Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144e4f88-4863-475f-89c6-756d756428ed could not be found. Aug 24 04:01:28.474947 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:28.476916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Returning 404 to user: Instance 144e4f88-4863-475f-89c6-756d756428ed could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:01:28.476916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-be24de54-fc1a-4a79-a319-f1ffedb69ced tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed" status: 404 len: 111 microversion: 2.1 time: 0.032423 Aug 24 04:01:28.476916 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 718/1401] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:28 2022] GET /compute/v2.1/servers/144e4f88-4863-475f-89c6-756d756428ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:01:29.230910 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-65316ac9-a711-4766-8911-af072994124f req-93a1bd9a-9664-45cd-b682-8a2e7696826a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:29.245213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-65316ac9-a711-4766-8911-af072994124f req-93a1bd9a-9664-45cd-b682-8a2e7696826a service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:29.247831 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-65316ac9-a711-4766-8911-af072994124f req-93a1bd9a-9664-45cd-b682-8a2e7696826a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:29.248485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-65316ac9-a711-4766-8911-af072994124f req-93a1bd9a-9664-45cd-b682-8a2e7696826a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:29.261279 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-65316ac9-a711-4766-8911-af072994124f req-93a1bd9a-9664-45cd-b682-8a2e7696826a service nova] Creating event network-changed:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:01:29.268204 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-65316ac9-a711-4766-8911-af072994124f req-93a1bd9a-9664-45cd-b682-8a2e7696826a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041080 Aug 24 04:01:29.268887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 684/1402] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:31.633773 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-630141785"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:31.634419 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:31.642246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:31.642969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:31.643290 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:31.643980 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:31.644435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:31.644865 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:31.778529 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.network.security_group_api [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Adding security group 20a6e8eb-8e5f-42d9-9681-14792ff52ea8 to port 03d9f77b-7ffb-452e-84f8-a444916b73d6 Aug 24 04:01:31.893553 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:31.894166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:31.901791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:31.902297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:31.903617 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:31.904532 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:31.904986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:31.905408 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:31.932331 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:01:32.164930 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ca482efc-e2cf-4b58-bd47-b9dfdb0e15a4 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/action" status: 202 len: 0 microversion: 2.1 time: 0.536208 Aug 24 04:01:32.165713 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 719/1403] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 04:01:31 2022] POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:01:32.234602 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5ffc0ead-c016-4f38-b280-4aa0a7ce2910 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 204 len: 0 microversion: 2.1 time: 0.345609 Aug 24 04:01:32.237992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 685/1404] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 04:01:31 2022] DELETE /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:32.245964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:32.251764 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:32.255454 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-2501bdad-1783-4f64-ad4c-f2d61d57ea82 req-77c3ac9a-e7db-4348-a51c-aab3e122dff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b623ffb6-0e7e-415a-a935-6483fc304ae7", "tag": "3b118ff2-c881-4155-9de9-cbf9bda38ef3"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:32.264655 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.265566 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.266367 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.267380 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.268086 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.268867 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.271502 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-2501bdad-1783-4f64-ad4c-f2d61d57ea82 req-77c3ac9a-e7db-4348-a51c-aab3e122dff7 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.272213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-2501bdad-1783-4f64-ad4c-f2d61d57ea82 req-77c3ac9a-e7db-4348-a51c-aab3e122dff7 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.272820 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-2501bdad-1783-4f64-ad4c-f2d61d57ea82 req-77c3ac9a-e7db-4348-a51c-aab3e122dff7 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.285574 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-2501bdad-1783-4f64-ad4c-f2d61d57ea82 req-77c3ac9a-e7db-4348-a51c-aab3e122dff7 service nova] Creating event network-changed:3b118ff2-c881-4155-9de9-cbf9bda38ef3 for instance b623ffb6-0e7e-415a-a935-6483fc304ae7 on hv-cinder-85425 Aug 24 04:01:32.292463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-2501bdad-1783-4f64-ad4c-f2d61d57ea82 req-77c3ac9a-e7db-4348-a51c-aab3e122dff7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124437 Aug 24 04:01:32.293986 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 720/1405] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:32.301074 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-59bb98a0-bec2-4b08-8df7-c5b9abb07bb7 req-442c2238-5bdb-4159-97b5-ff7e47d7f519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:32.312392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-59bb98a0-bec2-4b08-8df7-c5b9abb07bb7 req-442c2238-5bdb-4159-97b5-ff7e47d7f519 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.313189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-59bb98a0-bec2-4b08-8df7-c5b9abb07bb7 req-442c2238-5bdb-4159-97b5-ff7e47d7f519 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.313796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-59bb98a0-bec2-4b08-8df7-c5b9abb07bb7 req-442c2238-5bdb-4159-97b5-ff7e47d7f519 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.327000 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-59bb98a0-bec2-4b08-8df7-c5b9abb07bb7 req-442c2238-5bdb-4159-97b5-ff7e47d7f519 service nova] Creating event network-changed:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:01:32.333122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-59bb98a0-bec2-4b08-8df7-c5b9abb07bb7 req-442c2238-5bdb-4159-97b5-ff7e47d7f519 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037112 Aug 24 04:01:32.334040 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 721/1406] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:32.340148 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:32.341161 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:32.348231 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.349145 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.349891 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.351761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:32.352413 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:32.353095 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:32.516808 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:32.527440 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8fdf5edf-a034-4ff2-a681-30e462de0443 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1758 microversion: 2.1 time: 0.287875 Aug 24 04:01:32.528777 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 686/1407] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:32 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:32.546637 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:32.555430 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-676fe9d6-2bcc-4336-9bc1-e82fb0db100c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1575 microversion: 2.1 time: 0.219899 Aug 24 04:01:32.556556 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 722/1408] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:32 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:33.579724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:33.580295 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:33.588079 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:33.588563 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:33.588992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:33.589896 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:33.591176 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:33.592067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:33.820041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:33.829917 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7987070f-fc9b-4db7-b6e4-03e7bf84c551 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1575 microversion: 2.1 time: 0.254159 Aug 24 04:01:33.845056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 687/1409] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:33 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:34.309562 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-c3329b8a-ae7f-4229-981d-4072b11c2f38 req-5f703f2b-e999-40ab-8cf5-e0bf60b0b5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b623ffb6-0e7e-415a-a935-6483fc304ae7", "name": "network-vif-deleted", "tag": "3b118ff2-c881-4155-9de9-cbf9bda38ef3"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:34.320456 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c3329b8a-ae7f-4229-981d-4072b11c2f38 req-5f703f2b-e999-40ab-8cf5-e0bf60b0b5c0 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:34.327693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c3329b8a-ae7f-4229-981d-4072b11c2f38 req-5f703f2b-e999-40ab-8cf5-e0bf60b0b5c0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:34.327693 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-c3329b8a-ae7f-4229-981d-4072b11c2f38 req-5f703f2b-e999-40ab-8cf5-e0bf60b0b5c0 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.334022 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-c3329b8a-ae7f-4229-981d-4072b11c2f38 req-5f703f2b-e999-40ab-8cf5-e0bf60b0b5c0 service nova] Creating event network-vif-deleted:3b118ff2-c881-4155-9de9-cbf9bda38ef3 for instance b623ffb6-0e7e-415a-a935-6483fc304ae7 on hv-cinder-85425 Aug 24 04:01:34.339215 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-c3329b8a-ae7f-4229-981d-4072b11c2f38 req-5f703f2b-e999-40ab-8cf5-e0bf60b0b5c0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Aug 24 04:01:34.339549 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 723/1410] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:01:34.852814 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:34.853455 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:34.860022 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:34.860501 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:34.860935 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.861623 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:34.862098 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:34.862560 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.892642 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:34.893115 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:34.893550 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:34.893990 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lazy-loading 'fault' on Instance uuid b623ffb6-0e7e-415a-a935-6483fc304ae7 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:01:34.935658 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71ff73cade8b42c7ae57be1e3ef0e028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33235ed2b4cd48e7ac205143b814c6fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:34.943255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3467f130-7fd7-43b9-86d4-8bf2b61dad5d tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 200 len: 1230 microversion: 2.1 time: 0.094634 Aug 24 04:01:34.943820 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 688/1411] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:34 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:35.966326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:35.967030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: b623ffb6-0e7e-415a-a935-6483fc304ae7] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:35.973121 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:35.973603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:35.974038 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:35.974745 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:35.975450 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:35.975876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:35.989963 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] HTTP exception thrown: Instance b623ffb6-0e7e-415a-a935-6483fc304ae7 could not be found. Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Request method failure captured: Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 HTTP/1.1 Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaBQuTuIGAAB3fObggHoQW_Xno49tkv2gwkvr0o237akeNYQHpnrgN1SD64IeNJWpvBpatHnMSKfX5JIGeyjqDQBbDDkuvU2IeOJm796nbvbE5hGxD9KhpHnHMswLYUfKrchNrdnh675PqnVYcUH6U93yWs1yv8D8rOYhRJkM8GNFHE Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 04:01:35.991540 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 71ff73cade8b42c7ae57be1e3ef0e028 Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance b623ffb6-0e7e-415a-a935-6483fc304ae7 could not be found. Aug 24 04:01:35.993286 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': 'b623ffb6-0e7e-415a-a935-6483fc304ae7'} Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b623ffb6-0e7e-415a-a935-6483fc304ae7 could not be found. Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:01:35.994142 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b623ffb6-0e7e-415a-a935-6483fc304ae7 could not be found. Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b623ffb6-0e7e-415a-a935-6483fc304ae7 could not be found. Aug 24 04:01:35.995845 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:35.997686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Returning 404 to user: Instance b623ffb6-0e7e-415a-a935-6483fc304ae7 could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:01:35.997686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5a8d3da6-6a9e-4341-94e5-a8befb84030e tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7" status: 404 len: 111 microversion: 2.1 time: 0.032138 Aug 24 04:01:35.997686 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 724/1412] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:35 2022] GET /compute/v2.1/servers/b623ffb6-0e7e-415a-a935-6483fc304ae7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:01:36.546599 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:36.547106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:36.553419 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:36.553903 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:36.554388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.555081 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:36.555539 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:36.555965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.569615 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] HTTP exception thrown: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Request method failure captured: Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: DELETE /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d HTTP/1.1 Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaBQuTuIGAAB3fObggHoQW_Xno49tkv2gwkvr0o237akeNYQHpnrgN1SD64IeNJWpvBpatHnMSKfX5JIGeyjqDQBbDDkuvU2IeOJm796nbvbE5hGxD9KhpHnHMswLYUfKrchNrdnh675PqnVYcUH6U93yWs1yv8D8rOYhRJkM8GNFHE Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 04:01:36.571286 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 71ff73cade8b42c7ae57be1e3ef0e028 Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.573041 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '902ca0e0-691f-45a3-a98a-8ddfda13473d'} Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:01:36.573911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.576061 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.577425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Returning 404 to user: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:01:36.577425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-1697b1a5-09d9-491f-b177-64ba4a9a477c tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "DELETE /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 404 len: 111 microversion: 2.1 time: 0.030320 Aug 24 04:01:36.577425 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 689/1413] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 04:01:36 2022] DELETE /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:01:36.582069 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:36.582718 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] [instance: 902ca0e0-691f-45a3-a98a-8ddfda13473d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:36.588567 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:36.589033 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:36.589465 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.591109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:36.591622 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:36.592049 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:36.605458 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] HTTP exception thrown: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Request method failure captured: Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d HTTP/1.1 Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaBQuTuIGAAB3fObggHoQW_Xno49tkv2gwkvr0o237akeNYQHpnrgN1SD64IeNJWpvBpatHnMSKfX5JIGeyjqDQBbDDkuvU2IeOJm796nbvbE5hGxD9KhpHnHMswLYUfKrchNrdnh675PqnVYcUH6U93yWs1yv8D8rOYhRJkM8GNFHE Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 04:01:36.607976 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_33235ed2b4cd48e7ac205143b814c6fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: 33235ed2b4cd48e7ac205143b814c6fb Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-TestVolumeBootPattern-663059075 Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 71ff73cade8b42c7ae57be1e3ef0e028 Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-TestVolumeBootPattern-663059075-project Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.609740 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'id': '902ca0e0-691f-45a3-a98a-8ddfda13473d'} Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:01:36.610823 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. Aug 24 04:01:36.612437 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:01:36.613830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Returning 404 to user: Instance 902ca0e0-691f-45a3-a98a-8ddfda13473d could not be found. {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:01:36.613830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-cc34d8de-82e9-433d-b5b5-4095e4f1e548 tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d" status: 404 len: 111 microversion: 2.1 time: 0.031135 Aug 24 04:01:36.613830 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 725/1414] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:36 2022] GET /compute/v2.1/servers/902ca0e0-691f-45a3-a98a-8ddfda13473d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:01:38.129887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6b766d85-ff6e-465f-afa3-c157568dbfad tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] Calling method '.version_select at 0x7f6c1bf16040>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:38.212632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6b766d85-ff6e-465f-afa3-c157568dbfad tempest-TestVolumeBootPattern-663059075 tempest-TestVolumeBootPattern-663059075-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1056783115" status: 202 len: 0 microversion: 2.1 time: 0.086665 Aug 24 04:01:38.213219 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 690/1415] 10.222.0.65 () {58 vars in 1263 bytes} [Wed Aug 24 04:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1056783115 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:01:50.695267 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:01:50.695806 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 04:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:01:54.347317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:01:54.347889 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Wed Aug 24 04:01:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:01:55.345452 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:01:55.347691 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:55.349719 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=27 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.350679 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=53 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.355415 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:55.355904 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:55.356342 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:55.357048 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:55.357501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:55.357932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:55.581504 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d5c3294c-f3de-4e36-879c-10e757d93550 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/action" status: 202 len: 0 microversion: 2.1 time: 0.240614 Aug 24 04:01:55.582276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 726/1416] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 04:01:55 2022] POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:01:55.588725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.590180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.595407 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:55.597809 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:55.602840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:55.603321 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:55.603784 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:55.604507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:55.604952 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:55.605378 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:55.758164 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:55.767060 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-3a2ee08b-c192-4b1f-ae6b-2b04370a52c9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1750 microversion: 2.1 time: 0.180525 Aug 24 04:01:55.767627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 691/1417] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:55 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:56.790115 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:56.790888 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:56.799276 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:56.799757 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:56.800253 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:56.800950 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:56.801414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:56.801901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:56.949569 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:56.959127 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-72a653b4-cea8-43fe-a6d7-b283e5144120 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.173918 Aug 24 04:01:56.959700 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 727/1418] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:56 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:57.981690 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:57.982335 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:57.990830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:57.991423 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:57.991864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:57.992557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:57.993032 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:57.993459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:58.133524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:58.141798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-da90de9c-0e68-4e4f-821c-c04aaf2a46ec tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.164609 Aug 24 04:01:58.142390 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 692/1419] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:57 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:59.162996 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:01:59.163667 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:01:59.170065 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:59.170736 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:59.171662 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:59.172365 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:01:59.172818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:01:59.173246 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:01:59.317075 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:01:59.325218 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b169f62c-fcad-403d-9b2f-7caa7a44cd12 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.166151 Aug 24 04:01:59.325780 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 728/1420] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:01:59 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:00.347330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:00.347951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:00.354530 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:00.355010 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:00.355448 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:00.356134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:00.356633 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:00.357038 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:00.500607 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:00.508751 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-52ac169c-05b5-445c-9f8b-881aa7eb81eb tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.165390 Aug 24 04:02:00.509309 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 693/1421] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:00 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:01.529675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:01.531133 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:01.537438 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:01.537910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:01.538382 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:01.539067 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:01.539509 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:01.539928 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:01.683742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:01.692151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-a7471ac7-dee8-463b-bbd0-3df685b1d86b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.166301 Aug 24 04:02:01.692680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 729/1422] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:01 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:02.713683 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:02.714337 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:02.720922 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:02.721406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:02.721843 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:02.722630 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:02.723083 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:02.723510 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:02.864665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:02.872826 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fff6e3c9-af13-418f-988a-47a643c916d9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.163083 Aug 24 04:02:02.873393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 694/1423] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:02 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:03.896046 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:03.896758 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:03.903116 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:03.903593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:03.904029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:03.904721 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:03.905175 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:03.905632 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:04.052661 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:04.060994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-7c7f8c46-d25f-4106-8c21-ab15a22d398a tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.169111 Aug 24 04:02:04.061547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 730/1424] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:03 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:04.531272 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:04.532017 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:04.538311 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:04.538792 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:04.539227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:04.539913 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:04.540361 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:04.540783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:04.563902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lazy-loading 'flavor' on Instance uuid 45290dc1-ea22-4c71-8eec-503758124b99 {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:02:04.786812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-fa4f75ec-6a3b-4d09-bccc-a34ac644438c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "POST /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99/action" status: 202 len: 0 microversion: 2.1 time: 0.259703 Aug 24 04:02:04.787388 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 695/1425] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 04:02:04 2022] POST /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:02:04.795625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:04.796319 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:04.802283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:04.802774 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:04.803214 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:04.803909 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:04.804366 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:04.804796 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:04.939866 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:04.947797 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-0eace9b9-91d9-46f6-aaf7-07188a5db782 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.156092 Aug 24 04:02:04.948369 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 731/1426] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:04 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:05.084047 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:05.084665 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:05.090879 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:05.091355 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:05.091791 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:05.092472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:05.092920 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:05.093352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:05.236063 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:05.244619 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-7daf9e2d-55ad-4a4e-bc64-008b4796124e tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.164835 Aug 24 04:02:05.245199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 696/1427] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:05 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:05.970062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:05.970735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:05.977625 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:05.978108 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:05.978575 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:05.979278 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:05.979807 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:05.980243 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:06.116759 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:06.125026 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b728d282-3255-4ebd-b4d4-cf5f1321ba7e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.158403 Aug 24 04:02:06.125690 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 732/1428] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:05 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:06.266947 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:06.267551 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:06.273964 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:06.274476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:06.274911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:06.275593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:06.276039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:06.276457 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:06.420056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:06.428375 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-64a150e7-9bbb-40c8-82b9-acb458ca40a9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.166053 Aug 24 04:02:06.428918 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 697/1429] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:06 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:07.146262 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:07.146876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:07.153109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:07.153582 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:07.154016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:07.154729 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:07.155181 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:07.155603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:07.292203 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:07.300016 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-08481c32-7b24-4f69-9e9c-8cd01922783c tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.157632 Aug 24 04:02:07.300564 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 733/1430] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:07 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:07.449796 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:07.450450 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:07.456986 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:07.457470 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:07.457911 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:07.458636 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:07.459090 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:07.459514 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:07.600601 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:07.608902 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0c0061fd-c281-47f0-aefe-e844d6278dba tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1755 microversion: 2.1 time: 0.162789 Aug 24 04:02:07.609479 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 698/1431] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:07 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:08.320876 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:08.321500 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:08.327835 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:08.328311 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:08.328775 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:08.329472 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:08.329919 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:08.330372 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:08.466652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:08.475052 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-88fa87e8-14ec-492f-bf0f-005d048a166d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.157822 Aug 24 04:02:08.475613 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 734/1432] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:08 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:08.630195 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:08.630804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:08.637228 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:08.637711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:08.638146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:08.638854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:08.639301 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:08.639727 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:08.782398 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:08.790854 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f9414716-3297-4165-8f5b-c157af8cce4b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1758 microversion: 2.1 time: 0.165229 Aug 24 04:02:08.791415 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 699/1433] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:08 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:09.497019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:09.497666 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:09.504727 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:09.505207 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:09.505644 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:09.506371 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:09.506825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:09.507255 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:09.636251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:09.644593 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8b159367-db6a-40d7-a156-1fcbf6af27ec tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.151541 Aug 24 04:02:09.645150 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 735/1434] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:09 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:10.665718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:10.666320 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:10.672693 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:10.673163 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:10.674225 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:10.674904 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:10.675349 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:10.675767 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:10.810227 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:10.818863 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8f5a5910-427a-4411-accb-b46f7d40d387 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.157056 Aug 24 04:02:10.819421 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 700/1435] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:10 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:11.839838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:11.840390 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:11.846956 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:11.847440 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:11.847881 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:11.848571 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:11.849027 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:11.849463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:11.985014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:11.993547 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ff39a25e-56f2-4afd-9095-168cab759deb tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.157691 Aug 24 04:02:11.994109 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 736/1436] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:11 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:13.015459 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:13.016067 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:13.022998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:13.023478 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:13.023932 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:13.024598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:13.025049 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:13.025472 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:13.158482 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:13.166078 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-d845daff-f2c8-414c-b617-e1d800a9a900 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.154527 Aug 24 04:02:13.166666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 701/1437] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:13 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:02:14.186901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:14.187501 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:14.193675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:14.194219 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:14.194670 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:14.195375 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:14.195832 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:14.196327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:14.332435 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:14.340151 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ea25e915-17c0-4495-8d46-113b7db42422 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.157165 Aug 24 04:02:14.340717 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 737/1438] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:14 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:15.360825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:15.361970 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:15.368639 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:15.369130 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:15.369572 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:15.370304 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:15.370759 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:15.371185 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:15.504414 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:15.512610 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2c97daaf-c996-4b04-9734-f6e2ae9de4bc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.155602 Aug 24 04:02:15.513106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 702/1439] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:15 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:16.533480 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:16.534085 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:16.540603 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:16.541078 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:16.541514 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:16.542229 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:16.542682 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:16.543107 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:16.675901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:16.683704 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-52c275b3-743d-4fc8-8aab-a8b714292734 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.154046 Aug 24 04:02:16.684280 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 738/1440] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:16 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:17.705831 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:17.706466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:17.712866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:17.713347 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:17.713785 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:17.714504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:17.714958 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:17.715384 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:17.844259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:17.852394 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2216e49d-89e4-44ff-a978-a32fe79201d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.151136 Aug 24 04:02:17.852965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 703/1441] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:17 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:18.873137 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:18.873742 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:18.880463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:18.880944 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:18.881379 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:18.882063 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:18.882645 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:18.883071 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:19.017531 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:19.025418 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-69e21727-f999-4b73-9fd6-ed735fcc3ae4 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.156221 Aug 24 04:02:19.026247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 739/1442] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:18 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:20.047613 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:20.048165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:20.054624 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:20.055104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:20.055541 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:20.056241 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:20.056711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:20.057138 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:20.185119 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:20.193255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-39208e42-306f-4380-828c-af772fac061b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.149590 Aug 24 04:02:20.193825 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 704/1443] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:20 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:21.215172 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:21.215778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:21.222977 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:21.223462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:21.223905 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:21.224856 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:21.225318 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:21.225748 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:21.362640 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:21.370398 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2cb1a47d-a129-4596-87d7-e0d47b780261 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.159036 Aug 24 04:02:21.370967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 740/1444] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:21 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:22.392243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:22.392853 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:22.399214 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:22.399688 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:22.400118 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:22.400800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:22.401244 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:22.401661 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:22.420360 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:22.534447 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:22.542023 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-6a189b97-534d-4935-bd3b-575ad951f587 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.153796 Aug 24 04:02:22.542604 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 705/1445] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:22 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:23.565369 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:23.565969 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:23.572733 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:23.573217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:23.573724 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:23.574463 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:23.574925 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:23.575357 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:23.593838 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:23.710880 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:23.717225 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f6ab576a-7f00-47b8-ae9a-72ccbd119527 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.156273 Aug 24 04:02:23.717790 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 741/1446] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:23 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:24.739266 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:24.739823 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:24.746213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:24.746701 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:24.747168 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:24.747852 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:24.748304 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:24.748729 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:24.880643 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:24.888238 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-eec3f783-400f-4a77-b272-cc9cdc7806dc tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1571 microversion: 2.1 time: 0.152953 Aug 24 04:02:24.888798 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 706/1447] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:24 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:24.908814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:24.910513 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:24.916871 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:24.917348 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:24.917778 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:24.918490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:24.918967 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:24.919387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:24.963927 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127737) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 04:02:25.195771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c6afb7e5-4ae7-4f86-927a-a3abf1437f22 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "POST /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99/action" status: 202 len: 0 microversion: 2.1 time: 0.290793 Aug 24 04:02:25.196393 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 742/1448] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 04:02:24 2022] POST /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:02:25.204774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:25.205476 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:25.212622 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:25.213177 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:25.213774 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:25.214507 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:25.214965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:25.215393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:25.355027 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:25.363466 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ea638c9b-507a-4c52-8010-617e894a0e24 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1519 microversion: 2.1 time: 0.162549 Aug 24 04:02:25.364039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 707/1449] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:25 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:26.384387 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:26.385011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:26.387378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:26.392100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:26.393461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:26.393461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:26.393731 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:26.394217 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:26.395353 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:26.530837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:26.539447 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-1e820412-be95-4fda-920f-cfdaf04dafb5 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1519 microversion: 2.1 time: 0.159071 Aug 24 04:02:26.540014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 743/1450] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:26 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:27.560152 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:27.560765 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:27.568109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:27.568621 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:27.569074 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:27.569845 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:27.570327 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:27.570810 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:27.711554 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:27.719574 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-bafbb82a-3e39-44b1-8d68-b26fcb7bb45d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1521 microversion: 2.1 time: 0.163371 Aug 24 04:02:27.720146 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 708/1451] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:27 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:27.873763 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-d760e632-709b-4454-b406-881e83885d97 req-3e2babe8-ed07-4813-bdc7-a42f3ff72d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "name": "network-vif-unplugged", "status": "completed", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:27.885231 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d760e632-709b-4454-b406-881e83885d97 req-3e2babe8-ed07-4813-bdc7-a42f3ff72d3a service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:27.885708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d760e632-709b-4454-b406-881e83885d97 req-3e2babe8-ed07-4813-bdc7-a42f3ff72d3a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:27.886141 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d760e632-709b-4454-b406-881e83885d97 req-3e2babe8-ed07-4813-bdc7-a42f3ff72d3a service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:27.897334 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.compute.server_external_events [req-d760e632-709b-4454-b406-881e83885d97 req-3e2babe8-ed07-4813-bdc7-a42f3ff72d3a service nova] Unable to find a host for instance 45290dc1-ea22-4c71-8eec-503758124b99. Dropping event network-vif-unplugged {{(pid=127737) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 04:02:27.898240 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-d760e632-709b-4454-b406-881e83885d97 req-3e2babe8-ed07-4813-bdc7-a42f3ff72d3a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029109 Aug 24 04:02:27.899044 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 744/1452] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 04:02:28.741524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:28.742134 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:28.744452 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=37 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:28.749209 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:28.749689 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:28.750126 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:28.750847 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:28.751294 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:28.751718 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:28.882804 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:28.890492 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-b1bf32f4-81d9-4726-8fa8-d6e16c830cac tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.153426 Aug 24 04:02:28.891069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 709/1453] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:28 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:29.912295 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:29.912966 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:29.919238 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:29.919708 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:29.920138 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:29.920818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:29.921263 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:29.921684 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:30.052842 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:30.060610 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-e87f83f2-05b6-48db-aa17-6fba4fa4af17 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.153020 Aug 24 04:02:30.061170 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 745/1454] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:29 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:31.081165 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:31.081779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:31.088262 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:31.088740 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:31.089178 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:31.089864 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:31.090351 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:31.090783 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:31.223552 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:31.231747 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-45ffccd4-9256-4df5-8b64-7cdd6024a47f tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.154477 Aug 24 04:02:31.232307 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 710/1455] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:31 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:32.253062 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:32.253696 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:32.260296 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:32.260782 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:32.261228 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:32.261931 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:32.262428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:32.262859 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:32.393120 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:32.400911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ffb137f3-e0c3-4f51-b172-d453314f477e tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.151957 Aug 24 04:02:32.401477 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 746/1456] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:32 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:33.422598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:33.423278 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:33.430524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:33.430998 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:33.431432 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:33.432116 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:33.432557 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:33.433077 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:33.565648 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:33.573406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-f12cf399-fcaa-4014-aa97-bb3861542a18 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.154933 Aug 24 04:02:33.573972 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 711/1457] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:33 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:34.594332 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:34.594949 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:34.601639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:34.602122 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:34.602588 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:34.603283 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:34.603735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:34.604168 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:34.733735 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:34.742232 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-2042acdf-972b-46cc-a348-517eb42ed1c1 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.151804 Aug 24 04:02:34.742799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 747/1458] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:34 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:35.763363 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:35.767297 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:35.770111 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:35.770627 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:35.771066 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:35.772406 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:35.772870 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:35.773306 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:35.900908 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:35.908698 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-8644e6ce-8b73-45ae-aa68-7798a09e68d9 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.149477 Aug 24 04:02:35.909259 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 712/1459] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:35 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:36.929814 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:36.930428 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:36.937004 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:36.937479 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:36.937911 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:36.938623 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:36.939100 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:36.939560 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:37.077003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:37.085512 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-5f0574ec-02b6-4a3a-a2c6-704139e36177 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.159874 Aug 24 04:02:37.086077 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 748/1460] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:36 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:38.106275 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:38.106887 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:38.113264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.113736 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.114197 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.114891 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:38.115991 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:38.116412 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:38.250340 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:38.258437 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-2acf3784-0e40-4bba-866d-864260dfab4d tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.156004 Aug 24 04:02:38.259011 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 713/1461] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:38 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:39.279960 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:39.280572 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:39.286912 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:39.287385 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:39.288309 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:39.289338 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:39.289799 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:39.290251 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:39.423340 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:39.431936 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-99b36056-b539-49fe-b946-2ee165ecb6b6 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.155905 Aug 24 04:02:39.432496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 749/1462] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:39 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:39.925521 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-d272f378-76a8-40b2-b9e3-408f8225a146 req-3c06178c-4bff-49a2-ba5e-42c8ba7eb83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "name": "network-vif-plugged", "status": "completed", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:39.935509 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d272f378-76a8-40b2-b9e3-408f8225a146 req-3c06178c-4bff-49a2-ba5e-42c8ba7eb83f service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:39.940738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d272f378-76a8-40b2-b9e3-408f8225a146 req-3c06178c-4bff-49a2-ba5e-42c8ba7eb83f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:39.940738 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-d272f378-76a8-40b2-b9e3-408f8225a146 req-3c06178c-4bff-49a2-ba5e-42c8ba7eb83f service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:39.949089 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-d272f378-76a8-40b2-b9e3-408f8225a146 req-3c06178c-4bff-49a2-ba5e-42c8ba7eb83f service nova] Creating event network-vif-plugged:99852f4e-152c-485a-a027-71d139b1ee8b for instance 45290dc1-ea22-4c71-8eec-503758124b99 on hv-cinder-85425 Aug 24 04:02:39.954233 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-d272f378-76a8-40b2-b9e3-408f8225a146 req-3c06178c-4bff-49a2-ba5e-42c8ba7eb83f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Aug 24 04:02:39.954813 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 714/1463] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:40.452840 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:40.453466 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:40.460751 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.461235 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.461677 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.462433 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:40.462892 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:40.463326 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:40.594029 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:40.602660 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-b472b5d4-bbbe-4e2d-b0e5-29a1b7896300 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.153653 Aug 24 04:02:40.603227 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 750/1464] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:40 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:41.623866 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:41.624558 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:41.630711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:41.631188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:41.632167 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:41.632858 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:41.633299 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:41.633724 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:41.770234 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:41.778779 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-32c7cdaf-0b83-49a1-bad6-152a1ce15e76 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1577 microversion: 2.1 time: 0.159559 Aug 24 04:02:41.779344 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 715/1465] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:41 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:42.800028 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:42.800641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:42.807337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:42.807812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:42.808308 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:42.809007 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:42.809461 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:42.809887 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:42.949490 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:42.957168 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-892c3737-2ca6-4ebb-b73c-52a00b9f9c35 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1564 microversion: 2.1 time: 0.161162 Aug 24 04:02:42.957722 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 751/1466] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:42 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:47.582051 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-630141785"}} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:47.582626 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:47.590093 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:47.590598 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:47.591028 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:47.591708 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:47.592178 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:47.592594 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:47.718597 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.network.security_group_api [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Removing security group 20a6e8eb-8e5f-42d9-9681-14792ff52ea8 from port 03d9f77b-7ffb-452e-84f8-a444916b73d6 Aug 24 04:02:48.115439 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-ba9d8d27-dfa2-4a0c-b2ba-b2df4fcb3574 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/action" status: 202 len: 0 microversion: 2.1 time: 0.537230 Aug 24 04:02:48.116073 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 716/1467] 10.222.0.65 () {60 vars in 1278 bytes} [Wed Aug 24 04:02:47 2022] POST /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:02:48.125997 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-ffdf4d5a-d0a3-4cb8-8d77-f4009d9cb5be req-2548df06-a268-4401-974f-864aae70d0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:48.136584 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ffdf4d5a-d0a3-4cb8-8d77-f4009d9cb5be req-2548df06-a268-4401-974f-864aae70d0cf service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:48.137082 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ffdf4d5a-d0a3-4cb8-8d77-f4009d9cb5be req-2548df06-a268-4401-974f-864aae70d0cf service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:48.137497 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-ffdf4d5a-d0a3-4cb8-8d77-f4009d9cb5be req-2548df06-a268-4401-974f-864aae70d0cf service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:48.151070 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-ffdf4d5a-d0a3-4cb8-8d77-f4009d9cb5be req-2548df06-a268-4401-974f-864aae70d0cf service nova] Creating event network-changed:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:02:48.157672 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-ffdf4d5a-d0a3-4cb8-8d77-f4009d9cb5be req-2548df06-a268-4401-974f-864aae70d0cf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035702 Aug 24 04:02:48.158608 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 752/1468] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:49.363441 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:49.363965 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:49.371451 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.371934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.372371 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.373069 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.373543 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.373967 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.466418 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.objects.instance [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lazy-loading 'services' on Instance uuid 2c9c0873-60ff-4a99-a060-01b952a21d6d {{(pid=127736) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:02:49.719938 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-4ec0fb5d-ef7f-4f3b-bf63-96ccfeb6118f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments/16921b25-2c10-4a88-9183-1650d7bb35ad" status: 202 len: 0 microversion: 2.1 time: 0.360715 Aug 24 04:02:49.720494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 717/1469] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 04:02:49 2022] DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments/16921b25-2c10-4a88-9183-1650d7bb35ad => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:02:49.734554 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:49.736873 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:49.743710 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.744469 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.745424 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.746317 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:49.746769 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:49.747189 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:49.779420 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-6d77b5e5-b973-4875-b385-2c34cf02cb57 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053244 Aug 24 04:02:49.780203 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 753/1470] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 04:02:49 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:50.174080 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-f8212291-640d-4e8c-a0f4-2b3693d3a368 req-2b337aa3-2194-48cb-bebc-73fd82dd9120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:50.183812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f8212291-640d-4e8c-a0f4-2b3693d3a368 req-2b337aa3-2194-48cb-bebc-73fd82dd9120 service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.184287 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f8212291-640d-4e8c-a0f4-2b3693d3a368 req-2b337aa3-2194-48cb-bebc-73fd82dd9120 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.184711 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-f8212291-640d-4e8c-a0f4-2b3693d3a368 req-2b337aa3-2194-48cb-bebc-73fd82dd9120 service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.195992 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-f8212291-640d-4e8c-a0f4-2b3693d3a368 req-2b337aa3-2194-48cb-bebc-73fd82dd9120 service nova] Creating event network-changed:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:02:50.201255 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-f8212291-640d-4e8c-a0f4-2b3693d3a368 req-2b337aa3-2194-48cb-bebc-73fd82dd9120 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031219 Aug 24 04:02:50.201840 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 718/1471] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:50.792478 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:50.794650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:50.801096 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.801579 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.802014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.802770 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:50.803226 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:50.803650 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:50.835247 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-20e48964-c82b-4217-b56e-e1a0e6cfdd5c tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Aug 24 04:02:50.835812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 754/1472] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 04:02:50 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:51.848003 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:51.850524 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:51.857104 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.857579 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.858012 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.858722 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.859172 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.859593 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.887632 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-dd2f513a-285e-479b-bd76-49fa36815fcf tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043983 Aug 24 04:02:51.888171 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 719/1473] 10.222.0.65 () {58 vars in 1302 bytes} [Wed Aug 24 04:02:51 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:02:51.898468 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:51.899006 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:51.905299 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.905777 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.906249 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.906942 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:51.907392 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:51.907812 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:51.982314 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.wsgi [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] HTTP exception thrown: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d is not attached to volume 16921b25-2c10-4a88-9183-1650d7bb35ad Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Request method failure captured: Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: request: DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments/16921b25-2c10-4a88-9183-1650d7bb35ad HTTP/1.1 Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept: application/json Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Accept-Encoding: identity Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Connection: close Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Length: 0 Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Content-Type: application/json Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Host: 10.222.0.65 Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Openstack-System-Scope: None Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: User-Agent: python-urllib3/1.26.11 Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Auth-Token: gAAAAABjBaJeJgvPtYq9c1Q988Ol5ehqvf43lTORZM9_JiGJy9y6zaUTHhu0mEIPhLhBpSxBUvM0zIK2d03wA0Dali2zLUe-UK2GTjXNR5HQ5B29UW0V5pGwUbenOQm_Y_mh6MhAOTlitkMEznKVZ0N8w8OxlsG-wJCX-HZs2A3srcISjztUy-4 Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Id: None Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Domain-Name: None Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Identity-Status: Confirmed Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Is-Admin-Project: True Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Id: default Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Domain-Name: Default Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Id: e2c1183122314dbd8982c3d24a9b041e Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Project-Name: tempest-TestMinimumBasicScenario-2121407983 Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Role: member,reader Aug 24 04:02:51.984675 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Roles: member,reader Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant: tempest-TestMinimumBasicScenario-2121407983 Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Id: e2c1183122314dbd8982c3d24a9b041e Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2121407983 Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User: tempest-TestMinimumBasicScenario-2121407983-project Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Id: default Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Domain-Name: Default Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Id: 541f59acaa84467783f63c278a7f0485 Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: X-User-Name: tempest-TestMinimumBasicScenario-2121407983-project Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: method: > Aug 24 04:02:51.990352 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: exception: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d is not attached to volume 16921b25-2c10-4a88-9183-1650d7bb35ad Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: action_args: {'server_id': '2c9c0873-60ff-4a99-a060-01b952a21d6d', 'id': '16921b25-2c10-4a88-9183-1650d7bb35ad'} Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16921b25-2c10-4a88-9183-1650d7bb35ad. Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:02:51.991337 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d is not attached to volume 16921b25-2c10-4a88-9183-1650d7bb35ad Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d is not attached to volume 16921b25-2c10-4a88-9183-1650d7bb35ad Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: ERROR nova.api.openstack.wsgi Aug 24 04:02:51.993901 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Returning 404 to user: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d is not attached to volume 16921b25-2c10-4a88-9183-1650d7bb35ad {{(pid=127737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:02:51.995652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-513ea063-0a3a-4621-b6cf-74e6bb55357b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments/16921b25-2c10-4a88-9183-1650d7bb35ad" status: 404 len: 154 microversion: 2.1 time: 0.091582 Aug 24 04:02:51.995652 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 755/1474] 10.222.0.65 () {58 vars in 1416 bytes} [Wed Aug 24 04:02:51 2022] DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d/os-volume_attachments/16921b25-2c10-4a88-9183-1650d7bb35ad => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:02:53.275392 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:53.277569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:53.282243 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:53.282749 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:53.283188 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.283875 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:53.284330 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:53.284756 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.287417 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:53.310105 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:02:53.576881 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-17a9b2cc-53fe-436b-85c6-d5041944d683 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 204 len: 0 microversion: 2.1 time: 0.305423 Aug 24 04:02:53.577393 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 720/1475] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 04:02:53 2022] DELETE /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:02:53.585563 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:53.589414 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:53.593196 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:53.593680 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:53.594114 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.594837 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:53.595291 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:53.595722 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:53.727287 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:53.729629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:53.735768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-05eee09b-145a-4d6d-a3a9-56f4f9b4715b tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1554 microversion: 2.1 time: 0.154112 Aug 24 04:02:53.736327 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 756/1476] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:53 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:54.757434 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:54.758043 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:54.764824 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:54.765293 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:54.765725 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:54.766504 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:54.766951 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:54.767369 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:54.900291 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:54.907874 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-9860c09f-452d-411c-b9ab-b02962f1dfc9 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1554 microversion: 2.1 time: 0.154716 Aug 24 04:02:54.908444 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 721/1477] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:54 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:55.929587 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:55.930250 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:55.937639 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:55.938117 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:55.938597 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:55.939271 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:55.939768 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:55.940197 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:56.069273 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:56.077014 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-f29e5bfd-8d14-4135-a64a-539bf8058c89 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1554 microversion: 2.1 time: 0.151743 Aug 24 04:02:56.077573 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 757/1478] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:55 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:56.953264 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-260d65ef-e2a7-41a6-a64e-4cdba74efd8c req-cf93873f-cae9-4772-b6ff-314b19967bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9c0873-60ff-4a99-a060-01b952a21d6d", "name": "network-vif-deleted", "tag": "03d9f77b-7ffb-452e-84f8-a444916b73d6"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:02:56.958730 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-260d65ef-e2a7-41a6-a64e-4cdba74efd8c req-cf93873f-cae9-4772-b6ff-314b19967bea service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:56.959212 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-260d65ef-e2a7-41a6-a64e-4cdba74efd8c req-cf93873f-cae9-4772-b6ff-314b19967bea service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:56.959761 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-260d65ef-e2a7-41a6-a64e-4cdba74efd8c req-cf93873f-cae9-4772-b6ff-314b19967bea service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:56.971039 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-260d65ef-e2a7-41a6-a64e-4cdba74efd8c req-cf93873f-cae9-4772-b6ff-314b19967bea service nova] Creating event network-vif-deleted:03d9f77b-7ffb-452e-84f8-a444916b73d6 for instance 2c9c0873-60ff-4a99-a060-01b952a21d6d on hv-cinder-85425 Aug 24 04:02:56.976304 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-260d65ef-e2a7-41a6-a64e-4cdba74efd8c req-cf93873f-cae9-4772-b6ff-314b19967bea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032288 Aug 24 04:02:56.979812 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 722/1479] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:02:57.098825 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:57.099698 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:57.106112 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:57.108025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:57.108025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:57.108025 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:57.108378 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:57.108750 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:57.173885 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '541f59acaa84467783f63c278a7f0485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2c1183122314dbd8982c3d24a9b041e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:02:57.181815 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-ba3be005-cf3b-4d74-875a-4394358ce145 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 200 len: 1343 microversion: 2.1 time: 0.086868 Aug 24 04:02:57.183030 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 758/1480] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:57 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 1343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:02:58.204871 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:58.205564 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] [instance: 2c9c0873-60ff-4a99-a060-01b952a21d6d] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:02:58.211741 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:58.212223 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:58.212657 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:58.213931 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:02:58.214404 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:02:58.214830 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:02:58.229379 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] HTTP exception thrown: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d could not be found. Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Request method failure captured: Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d HTTP/1.1 Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaJeJgvPtYq9c1Q988Ol5ehqvf43lTORZM9_JiGJy9y6zaUTHhu0mEIPhLhBpSxBUvM0zIK2d03wA0Dali2zLUe-UK2GTjXNR5HQ5B29UW0V5pGwUbenOQm_Y_mh6MhAOTlitkMEznKVZ0N8w8OxlsG-wJCX-HZs2A3srcISjztUy-4 Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: e2c1183122314dbd8982c3d24a9b041e Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-TestMinimumBasicScenario-2121407983 Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 04:02:58.230983 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e2c1183122314dbd8982c3d24a9b041e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-TestMinimumBasicScenario-2121407983 Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: e2c1183122314dbd8982c3d24a9b041e Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2121407983 Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-TestMinimumBasicScenario-2121407983-project Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 541f59acaa84467783f63c278a7f0485 Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-TestMinimumBasicScenario-2121407983-project Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d could not be found. Aug 24 04:02:58.232770 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '2c9c0873-60ff-4a99-a060-01b952a21d6d'} Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d could not be found. Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:02:58.233841 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d could not be found. Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d could not be found. Aug 24 04:02:58.235934 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:02:58.237519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Returning 404 to user: Instance 2c9c0873-60ff-4a99-a060-01b952a21d6d could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:02:58.237519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-391f8462-b3a8-4a5b-9932-084f892b1b62 tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d" status: 404 len: 111 microversion: 2.1 time: 0.032393 Aug 24 04:02:58.237519 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 723/1481] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:02:58 2022] GET /compute/v2.1/servers/2c9c0873-60ff-4a99-a060-01b952a21d6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:02:58.241381 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-c120af70-3960-4f7a-8b41-e1694633dd1f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] Calling method '.version_select at 0x7f6c1804b8b0>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:02:58.252360 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=32 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:58.337511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-c120af70-3960-4f7a-8b41-e1694633dd1f tempest-TestMinimumBasicScenario-2121407983 tempest-TestMinimumBasicScenario-2121407983-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779408328" status: 202 len: 0 microversion: 2.1 time: 0.099910 Aug 24 04:02:58.338099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 759/1482] 10.222.0.65 () {58 vars in 1272 bytes} [Wed Aug 24 04:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1779408328 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:04:05.703224 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:05.704401 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG dbcounter [-] [127736] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:05.704883 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_cell1:SELECT=13 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:05.705714 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG dbcounter [-] [127737] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=127737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:05.708793 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:05.709352 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:05.709641 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [req-d8736f03-502b-452e-836d-bbe642d7aa06 req-9cf856ae-1e90-4a52-a267-5bbe461dcaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:05.715829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.716317 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.717071 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:05.717800 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.718339 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.718773 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:05.719761 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d8736f03-502b-452e-836d-bbe642d7aa06 req-9cf856ae-1e90-4a52-a267-5bbe461dcaea service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:05.720239 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d8736f03-502b-452e-836d-bbe642d7aa06 req-9cf856ae-1e90-4a52-a267-5bbe461dcaea service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:05.720674 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [req-d8736f03-502b-452e-836d-bbe642d7aa06 req-9cf856ae-1e90-4a52-a267-5bbe461dcaea service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:05.731818 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.compute.server_external_events [req-d8736f03-502b-452e-836d-bbe642d7aa06 req-9cf856ae-1e90-4a52-a267-5bbe461dcaea service nova] Creating event network-changed:99852f4e-152c-485a-a027-71d139b1ee8b for instance 45290dc1-ea22-4c71-8eec-503758124b99 on hv-cinder-85425 Aug 24 04:04:05.737754 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [req-d8736f03-502b-452e-836d-bbe642d7aa06 req-9cf856ae-1e90-4a52-a267-5bbe461dcaea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034224 Aug 24 04:04:05.741429 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 760/1483] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:04:05.760021 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Going to try to terminate instance {{(pid=127736) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:04:06.049399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-5b62df96-75ea-4b78-a2ea-e4fba0c53bbe tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "DELETE /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 204 len: 0 microversion: 2.1 time: 0.347921 Aug 24 04:04:06.050035 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 724/1484] 10.222.0.65 () {58 vars in 1239 bytes} [Wed Aug 24 04:04:05 2022] DELETE /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:04:06.059629 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:06.060511 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:06.067099 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:06.067687 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:06.068201 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:06.068984 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:06.069516 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:06.070019 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:06.323994 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:06.332198 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-04f32afb-ac4f-4c1f-a368-15b3187d8804 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.277261 Aug 24 04:04:06.333003 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 761/1485] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:06 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:07.355460 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:07.356166 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:07.364357 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:07.364836 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:07.365303 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:07.365995 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:07.366485 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:07.366914 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:07.558109 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.policy [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127736) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:07.565865 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-0bd98380-dbcd-4843-a8aa-9d67c672f54b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1570 microversion: 2.1 time: 0.215054 Aug 24 04:04:07.566468 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 725/1486] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:07 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:08.587154 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:08.588373 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:08.595059 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:08.599709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:08.599709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:08.599709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:08.599709 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:08.600932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:08.664462 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:08.665290 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [req-e88c82f4-e562-4914-9281-658a0feaba3e req-29b4f036-6a9a-4e64-9927-383e636117bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45290dc1-ea22-4c71-8eec-503758124b99", "name": "network-vif-deleted", "tag": "99852f4e-152c-485a-a027-71d139b1ee8b"}]} {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:04:08.675854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-d21ba32e-07f3-4c1d-a07d-ae0536958e67 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1383 microversion: 2.1 time: 0.091051 Aug 24 04:04:08.675854 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 762/1487] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:08 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1383 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:04:08.676180 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-e88c82f4-e562-4914-9281-658a0feaba3e req-29b4f036-6a9a-4e64-9927-383e636117bf service nova] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:08.676670 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-e88c82f4-e562-4914-9281-658a0feaba3e req-29b4f036-6a9a-4e64-9927-383e636117bf service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:08.677106 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [req-e88c82f4-e562-4914-9281-658a0feaba3e req-29b4f036-6a9a-4e64-9927-383e636117bf service nova] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:08.689034 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.compute.server_external_events [req-e88c82f4-e562-4914-9281-658a0feaba3e req-29b4f036-6a9a-4e64-9927-383e636117bf service nova] Creating event network-vif-deleted:99852f4e-152c-485a-a027-71d139b1ee8b for instance 45290dc1-ea22-4c71-8eec-503758124b99 on hv-cinder-85425 Aug 24 04:04:08.694619 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [req-e88c82f4-e562-4914-9281-658a0feaba3e req-29b4f036-6a9a-4e64-9927-383e636117bf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032923 Aug 24 04:04:08.695565 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 726/1488] 10.222.0.65 () {64 vars in 1317 bytes} [Wed Aug 24 04:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:04:09.696755 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:09.697355 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.compute.api [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127737) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:09.704213 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.705410 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.705410 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:09.705771 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.706274 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.706723 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:09.740011 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:09.744284 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:09.744284 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG oslo_concurrency.lockutils [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:09.744284 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.objects.instance [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lazy-loading 'fault' on Instance uuid 45290dc1-ea22-4c71-8eec-503758124b99 {{(pid=127737) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:04:09.783586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.policy [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6683479f4e1c419e950fa7497f194ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6382d0a8d141e9ab64a41ae43b12af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127737) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:04:09.791473 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-007307a0-c906-4070-acb2-4e134a6fb30b tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 200 len: 1225 microversion: 2.1 time: 0.098777 Aug 24 04:04:09.792035 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 763/1489] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:09 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:04:10.817329 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '>' {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:10.817946 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.compute.api [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] [instance: 45290dc1-ea22-4c71-8eec-503758124b99] Fetching instance by UUID {{(pid=127736) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:04:10.824569 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:10.825053 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:10.825494 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:10.826213 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Acquiring lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:04:10.826666 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:04:10.827088 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG oslo_concurrency.lockutils [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Lock "20ac877f-df8d-47d5-b692-2747fb47c4f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:04:10.840056 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.wsgi [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] HTTP exception thrown: Instance 45290dc1-ea22-4c71-8eec-503758124b99 could not be found. Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Request method failure captured: Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: request: GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 HTTP/1.1 Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept: application/json Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Accept-Encoding: identity Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Connection: close Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Length: 0 Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Content-Type: application/json Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Host: 10.222.0.65 Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Openstack-System-Scope: None Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: User-Agent: python-urllib3/1.26.11 Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Auth-Token: gAAAAABjBaHs86zdC7p3yqszXb2E1Ieani4b4qkJxV8u0xrQR2aTgEY7kc7O7wAIA1SO0qwH15B1aCJWkuZWyZIcdzAZGHrGddUP6RoCO3NCmxrpI2sVvBDJNExgyxB9nFgX17JTx89f34BOWmKYTanFqldJhMYx1FkiHO9gTA_Q05QBs0uZnOk Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Id: None Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Domain-Name: None Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Identity-Status: Confirmed Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Is-Admin-Project: True Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Id: default Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Domain-Name: Default Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Id: 7a6382d0a8d141e9ab64a41ae43b12af Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Project-Name: tempest-TestShelveInstance-141200653 Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Role: member,reader Aug 24 04:04:10.842199 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Roles: member,reader Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7a6382d0a8d141e9ab64a41ae43b12af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7a6382d0a8d141e9ab64a41ae43b12af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7a6382d0a8d141e9ab64a41ae43b12af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7a6382d0a8d141e9ab64a41ae43b12af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}] Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant: tempest-TestShelveInstance-141200653 Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Id: 7a6382d0a8d141e9ab64a41ae43b12af Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-Tenant-Name: tempest-TestShelveInstance-141200653 Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User: tempest-TestShelveInstance-141200653-project Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Id: default Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Domain-Name: Default Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Id: 6683479f4e1c419e950fa7497f194ac1 Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: X-User-Name: tempest-TestShelveInstance-141200653-project Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: method: > Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: exception: Instance 45290dc1-ea22-4c71-8eec-503758124b99 could not be found. Aug 24 04:04:10.844829 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: action_args: {'id': '45290dc1-ea22-4c71-8eec-503758124b99'} Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: {{(pid=127736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45290dc1-ea22-4c71-8eec-503758124b99 could not be found. Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:04:10.846453 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45290dc1-ea22-4c71-8eec-503758124b99 could not be found. Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45290dc1-ea22-4c71-8eec-503758124b99 could not be found. Aug 24 04:04:10.849203 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: ERROR nova.api.openstack.wsgi Aug 24 04:04:10.852192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: DEBUG nova.api.openstack.wsgi [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Returning 404 to user: Instance 45290dc1-ea22-4c71-8eec-503758124b99 could not be found. {{(pid=127736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:04:10.852192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO nova.api.openstack.requestlog [None req-325280b5-b3a4-4c92-a009-9d505e8befa2 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99" status: 404 len: 111 microversion: 2.1 time: 0.030589 Aug 24 04:04:10.852192 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: [pid: 127736|app: 0|req: 727/1490] 10.222.0.65 () {58 vars in 1236 bytes} [Wed Aug 24 04:04:10 2022] GET /compute/v2.1/servers/45290dc1-ea22-4c71-8eec-503758124b99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:04:11.078586 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: DEBUG nova.api.openstack.wsgi [None req-8075dbd4-78c7-45eb-bd8b-5a60bc801ac8 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] Calling method '.version_select at 0x7f6c1804b700>' {{(pid=127737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:04:11.135598 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO nova.api.openstack.requestlog [None req-8075dbd4-78c7-45eb-bd8b-5a60bc801ac8 tempest-TestShelveInstance-141200653 tempest-TestShelveInstance-141200653-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1023374022" status: 202 len: 0 microversion: 2.1 time: 0.061946 Aug 24 04:04:11.136185 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: [pid: 127737|app: 0|req: 764/1491] 10.222.0.65 () {58 vars in 1254 bytes} [Wed Aug 24 04:04:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1023374022 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:04:26.019895 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:04:26.020493 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Wed Aug 24 04:04:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:14.357122 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:14.357878 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Wed Aug 24 04:05:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:05:17.504292 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:05:17.504932 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 04:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:06:50.705386 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:06:50.706068 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 04:06:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:07:09.752363 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:07:09.753103 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 04:07:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:07:11.520413 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:07:11.520975 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Wed Aug 24 04:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:07:46.028334 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:07:46.029057 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Wed Aug 24 04:07:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:08:34.365399 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:08:34.366269 dv-cinder-854259-1-iscsi devstack@n-api.service[127736]: Wed Aug 24 04:08:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:08:37.513910 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:08:37.514496 dv-cinder-854259-1-iscsi devstack@n-api.service[127737]: Wed Aug 24 04:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!